2024-09-16T14:43:01.440 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T14:43:01.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T14:43:01.538 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772 branch: reef description: rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906772' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: global: mon election default strategy: 3 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: ae7f37330c1a72493684eb1fcaed6f2a01195bb6 owner: scheduled_teuthology@teuthology priority: 931 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - - osd.3 - osd.4 - osd.5 - client.0 seed: 1390 sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 sleep_before_teardown: 0 subset: 5319/100000 suite: rados suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ae7f37330c1a72493684eb1fcaed6f2a01195bb6 targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPFNVjQ2LyC42LG7xQsU3/I8r5yZfpAhZ1FK4OFh8kkRFAuv531W3vm/9rqgtcTS/rzddCJQkc63/wgC/jj2lo= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHD/taT2s04WI14GJXRfEo6k+zPS3egS9TYPQgNYSihkXzuEt6jGAsjtRRNaqG4waPS1a7j8ghXsYL3CdV5xp3M= tasks: - install: null - ceph: log-ignorelist: - missing primary copy of - objects unfound and apparently lost - had a read error - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) - \(PG_DEGRADED\) - \(OSD_TOO_MANY_REPAIRS\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - full_sequential: - exec: client.0: - sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33 - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33 - sudo ceph osd pool create test 16 16 - sudo ceph osd pool set test size 3 - sudo ceph pg dump pgs --format=json-pretty - radosbench: clients: - client.0 create_pool: false objectsize: 1048576 pool: test time: 360 type: rand - exec: client.0: - sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0 - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_22:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T14:43:01.538 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa; will attempt to use it 2024-09-16T14:43:01.539 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa/tasks 2024-09-16T14:43:01.539 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T14:43:01.541 INFO:teuthology.task.internal:Checking packages... 2024-09-16T14:43:01.562 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8' 2024-09-16T14:43:01.563 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T14:43:01.563 INFO:teuthology.packaging:ref: None 2024-09-16T14:43:01.563 INFO:teuthology.packaging:tag: None 2024-09-16T14:43:01.563 INFO:teuthology.packaging:branch: reef 2024-09-16T14:43:01.563 INFO:teuthology.packaging:sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:43:01.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-09-16T14:43:01.806 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-853-gae7f3733-1jammy 2024-09-16T14:43:01.807 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T14:43:01.814 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T14:43:01.814 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T14:43:01.934 INFO:teuthology.task.internal:Saving configuration 2024-09-16T14:43:01.946 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T14:43:02.100 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T14:43:02.127 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 14:37:27.336006', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL6rS/M0KZ29Dl3X7TPQdIee/n9mmpM6LikWcsSgSyK0'} 2024-09-16T14:43:02.147 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 14:37:27.337381', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO8c/2/KHiasy4Cri0GC9mpzw489XUJeVfybnKZbMNNp'} 2024-09-16T14:43:02.147 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T14:43:02.185 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2024-09-16T14:43:02.185 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-09-16T14:43:02.185 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T14:43:02.322 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f08bd39b1c0>, signals=[15]) 2024-09-16T14:43:02.322 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T14:43:02.371 INFO:teuthology.task.internal:Opening connections... 2024-09-16T14:43:02.372 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T14:43:02.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:43:02.457 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T14:43:02.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:43:02.538 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T14:43:02.545 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-16T14:43:02.550 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-16T14:43:02.550 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-16T14:43:02.595 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T14:43:02.595 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2024-09-16T14:43:02.595 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2024-09-16T14:43:02.595 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T14:43:02.596 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2024-09-16T14:43:02.597 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-16T14:43:02.615 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-16T14:43:02.619 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-16T14:43:02.620 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-16T14:43:02.666 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-16T14:43:02.666 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T14:43:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy 2024-09-16T14:43:02.668 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-16T14:43:02.690 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T14:43:02.705 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T14:43:02.822 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T14:43:02.823 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-16T14:43:02.825 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-16T14:43:02.830 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T14:43:02.887 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T14:43:02.887 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-16T14:43:02.889 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-16T14:43:02.896 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T14:43:02.956 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T14:43:03.019 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T14:43:03.019 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.3': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T14:43:03.020 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T14:43:03.020 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T14:43:03.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:43:03.025 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-16T14:43:03.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:43:03.026 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-16T14:43:03.071 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-56-generic 2024-09-16T14:43:03.071 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.15.0-56-generic 2024-09-16T14:43:03.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get clean 2024-09-16T14:43:03.073 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2024-09-16T14:43:03.073 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2024-09-16T14:43:03.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-16T14:43:03.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-16T14:43:03.206 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-09-16T14:43:03.330 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T14:43:03.441 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T14:43:03.471 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T14:43:03.481 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-16T14:43:03.522 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T14:43:03.539 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-16T14:43:03.555 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T14:43:03.624 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T14:43:03.661 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T14:43:03.663 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T14:43:03.664 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T14:43:03.664 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T14:43:03.682 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T14:43:03.685 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T14:43:03.685 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T14:43:03.689 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T14:43:03.694 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T14:43:03.695 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T14:43:03.697 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T14:43:03.697 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T14:43:03.706 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T14:43:03.714 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T14:43:03.879 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T14:43:03.894 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-16T14:43:03.912 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-16T14:43:04.018 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T14:43:04.032 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-16T14:43:04.206 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-16T14:43:04.213 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,025 kB] 2024-09-16T14:43:04.226 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,025 kB] 2024-09-16T14:43:04.372 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [353 kB] 2024-09-16T14:43:04.380 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-16T14:43:04.385 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [353 kB] 2024-09-16T14:43:04.386 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T14:43:04.387 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T14:43:04.388 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,441 kB] 2024-09-16T14:43:04.392 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-16T14:43:04.393 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-16T14:43:04.394 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-16T14:43:04.399 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-16T14:43:04.400 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,441 kB] 2024-09-16T14:43:04.457 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [420 kB] 2024-09-16T14:43:04.469 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-16T14:43:04.473 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T14:43:04.474 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T14:43:04.504 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T14:43:04.523 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T14:43:04.528 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [420 kB] 2024-09-16T14:43:04.528 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-16T14:43:04.529 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T14:43:04.535 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-16T14:43:04.536 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-16T14:43:04.536 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T14:43:04.536 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-16T14:43:04.536 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-16T14:43:04.537 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T14:43:04.537 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T14:43:04.549 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-16T14:43:04.549 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-16T14:43:04.562 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-16T14:43:04.565 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-16T14:43:04.566 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-16T14:43:04.566 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-16T14:43:04.567 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-16T14:43:04.568 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-16T14:43:04.572 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-16T14:43:04.572 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-16T14:43:04.573 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-16T14:43:04.612 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T14:43:04.612 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T14:43:04.614 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T14:43:04.615 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T14:43:04.615 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T14:43:04.617 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T14:43:04.618 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T14:43:04.628 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-16T14:43:04.631 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-16T14:43:04.631 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-16T14:43:04.632 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-16T14:43:04.633 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-16T14:43:04.656 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-16T14:43:04.656 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-16T14:43:04.657 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-16T14:43:04.657 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-16T14:43:04.658 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T14:43:04.699 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-16T14:43:04.700 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T14:43:04.713 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-16T14:43:10.011 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 16.0 MB in 2s (7,559 kB/s) 2024-09-16T14:43:10.606 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 16.0 MB in 3s (5,906 kB/s) 2024-09-16T14:43:11.532 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-09-16T14:43:11.549 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:43:11.650 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-09-16T14:43:11.862 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-09-16T14:43:11.862 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-09-16T14:43:12.022 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-16T14:43:12.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:43:12.050 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:43:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T14:43:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T14:43:12.050 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T14:43:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T14:43:12.051 INFO:teuthology.orchestra.run.smithi116.stdout: python2.7-minimal 2024-09-16T14:43:12.051 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:43:12.052 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-09-16T14:43:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T14:43:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T14:43:12.052 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T14:43:12.054 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-09-16T14:43:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T14:43:12.054 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-09-16T14:43:12.054 INFO:teuthology.orchestra.run.smithi116.stdout: thermald 2024-09-16T14:43:12.093 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-16T14:43:12.107 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-09-16T14:43:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T14:43:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T14:43:12.107 INFO:teuthology.orchestra.run.smithi116.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T14:43:12.109 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages will be upgraded: 2024-09-16T14:43:12.109 INFO:teuthology.orchestra.run.smithi116.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T14:43:12.164 INFO:teuthology.orchestra.run.smithi116.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T14:43:12.164 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 113 MB of archives. 2024-09-16T14:43:12.164 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T14:43:12.164 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T14:43:12.288 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-16T14:43:12.288 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-16T14:43:12.458 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:43:12.458 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T14:43:12.458 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T14:43:12.458 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T14:43:12.458 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-16T14:43:12.459 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2024-09-16T14:43:12.459 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:43:12.460 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-16T14:43:12.460 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T14:43:12.460 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-16T14:43:12.460 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-16T14:43:12.461 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-16T14:43:12.461 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-16T14:43:12.461 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-16T14:43:12.461 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2024-09-16T14:43:12.511 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-16T14:43:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-16T14:43:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-16T14:43:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-16T14:43:12.513 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-09-16T14:43:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T14:43:12.565 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T14:43:12.565 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2024-09-16T14:43:12.565 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-16T14:43:12.565 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-16T14:43:12.574 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T14:43:12.659 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T14:43:12.983 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-16T14:43:13.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-16T14:43:13.421 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T14:43:13.421 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T14:43:13.421 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T14:43:13.538 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T14:43:13.636 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T14:43:14.034 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 113 MB in 2s (74.5 MB/s) 2024-09-16T14:43:14.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-16T14:43:14.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-16T14:43:14.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-16T14:43:14.215 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T14:43:14.252 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-16T14:43:14.274 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-16T14:43:14.750 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 2s (62.2 MB/s) 2024-09-16T14:43:14.944 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-16T14:43:16.242 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T14:43:16.247 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:16.578 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:17.009 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-16T14:43:17.142 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:17.142 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:18.745 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T14:43:18.766 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:18.851 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:19.309 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-16T14:43:19.331 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:19.340 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T14:43:19.361 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:19.398 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:19.400 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:19.905 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-16T14:43:19.925 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:19.963 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:26.590 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T14:43:26.714 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T14:43:26.771 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T14:43:26.923 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T14:43:27.030 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T14:43:27.151 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T14:43:27.255 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T14:43:27.376 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T14:43:27.438 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T14:43:27.460 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T14:43:27.512 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T14:43:27.704 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-16T14:43:27.717 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-16T14:43:27.762 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T14:43:33.768 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T14:43:33.806 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:33.863 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-16T14:43:33.900 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-16T14:43:33.906 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:33.938 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:36.626 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T14:43:36.726 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-16T14:43:36.748 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T14:43:36.850 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-16T14:43:37.089 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T14:43:37.187 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:37.242 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-16T14:43:37.288 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T14:43:37.363 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:37.407 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:37.514 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-16T14:43:37.634 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:38.866 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T14:43:38.866 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T14:43:38.866 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T14:43:38.866 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T14:43:39.062 INFO:teuthology.orchestra.run.smithi116.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-16T14:43:39.062 INFO:teuthology.orchestra.run.smithi116.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-16T14:43:39.062 INFO:teuthology.orchestra.run.smithi116.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-16T14:43:39.062 INFO:teuthology.orchestra.run.smithi116.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-16T14:43:39.769 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:39.854 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:41.178 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:41.304 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:42.570 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T14:43:42.688 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T14:43:42.689 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-16T14:43:42.798 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-16T14:43:42.839 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:42.896 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T14:43:42.896 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T14:43:42.925 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-16T14:43:42.986 INFO:teuthology.orchestra.run.smithi116.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T14:43:42.987 INFO:teuthology.orchestra.run.smithi116.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-16T14:43:57.162 INFO:teuthology.orchestra.run.smithi116.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T14:43:57.163 INFO:teuthology.orchestra.run.smithi116.stdout:Sourcing file `/etc/default/grub' 2024-09-16T14:43:57.178 INFO:teuthology.orchestra.run.smithi116.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:43:57.190 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T14:43:57.190 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2024-09-16T14:43:57.202 INFO:teuthology.orchestra.run.smithi116.stdout:Generating grub configuration file ... 2024-09-16T14:43:57.214 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:43:57.237 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2024-09-16T14:43:57.482 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T14:43:57.500 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T14:43:57.506 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T14:43:57.529 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T14:43:57.828 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T14:43:57.833 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T14:43:57.840 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T14:43:57.846 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T14:43:57.894 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T14:43:57.899 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T14:43:57.911 INFO:teuthology.orchestra.run.smithi116.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T14:43:57.917 INFO:teuthology.orchestra.run.smithi116.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T14:43:58.046 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T14:43:58.046 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T14:43:58.046 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T14:43:58.063 INFO:teuthology.orchestra.run.smithi116.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T14:43:58.063 INFO:teuthology.orchestra.run.smithi116.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T14:43:58.063 INFO:teuthology.orchestra.run.smithi116.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T14:43:58.088 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-09-16T14:43:58.115 INFO:teuthology.orchestra.run.smithi116.stdout:done 2024-09-16T14:43:58.595 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.121.121 2024-09-16T14:43:58.613 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T14:43:58.614 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:43:58.614 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-16T14:43:58.614 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-16T14:43:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:43:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-16T14:43:58.614 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T14:43:58.614 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T14:43:58.614 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T14:43:58.614 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T14:43:58.615 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T14:43:58.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-16T14:43:58.618 DEBUG:teuthology.orchestra.run.smithi116:> dpkg -s linux-image-generic 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Package: linux-image-generic 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Status: install ok installed 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Priority: optional 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Section: kernel 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Installed-Size: 21 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: amd64 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Source: linux-meta 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Version: 5.15.0.121.121 2024-09-16T14:43:58.688 INFO:teuthology.orchestra.run.smithi116.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T14:43:58.689 INFO:teuthology.orchestra.run.smithi116.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:43:58.689 INFO:teuthology.orchestra.run.smithi116.stdout:Recommends: thermald 2024-09-16T14:43:58.689 INFO:teuthology.orchestra.run.smithi116.stdout:Description: Generic Linux kernel image 2024-09-16T14:43:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:43:58.689 INFO:teuthology.orchestra.run.smithi116.stdout: available. 2024-09-16T14:43:58.690 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-16T14:43:58.690 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T14:43:58.690 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T14:43:58.690 INFO:teuthology.task.kernel:Installing distro kernel on osd.3... 2024-09-16T14:43:58.690 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T14:43:58.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get clean 2024-09-16T14:43:58.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-16T14:43:58.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-09-16T14:43:58.966 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T14:43:58.974 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T14:43:59.089 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T14:43:59.094 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T14:43:59.171 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T14:43:59.175 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T14:43:59.253 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T14:43:59.257 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T14:44:00.415 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-16T14:44:00.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:44:00.457 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-09-16T14:44:00.476 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:44:00.494 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-16T14:44:00.538 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-09-16T14:44:00.707 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-16T14:44:00.708 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-16T14:44:00.750 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-09-16T14:44:00.750 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-09-16T14:44:00.892 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T14:44:00.893 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:44:00.926 INFO:teuthology.orchestra.run.smithi116.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-16T14:44:00.926 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:44:00.926 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T14:44:00.926 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T14:44:00.926 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T14:44:00.927 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T14:44:00.927 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T14:44:00.927 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:44:00.929 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T14:44:00.931 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-16T14:44:00.946 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-16T14:44:00.946 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-16T14:44:00.946 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-16T14:44:00.946 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-16T14:44:00.946 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-16T14:44:00.946 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.121.121 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-16T14:44:00.947 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:44:00.948 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-16T14:44:00.948 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-16T14:44:00.967 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-16T14:44:00.969 DEBUG:teuthology.orchestra.run.smithi116:> dpkg -s linux-image-generic 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Package: linux-image-generic 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Status: install ok installed 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Priority: optional 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Section: kernel 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Installed-Size: 21 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:44:00.981 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: amd64 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout:Source: linux-meta 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout:Version: 5.15.0.121.121 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout:Recommends: thermald 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout:Description: Generic Linux kernel image 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:44:00.982 INFO:teuthology.orchestra.run.smithi116.stdout: available. 2024-09-16T14:44:00.982 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-16T14:44:00.994 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.1AYksyoFSV 2024-09-16T14:44:00.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.1AYksyoFSV 2024-09-16T14:44:01.025 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.tqlxMtf9S7 2024-09-16T14:44:01.026 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tqlxMtf9S7 2024-09-16T14:44:01.049 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.1AYksyoFSV 2024-09-16T14:44:01.082 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.tqlxMtf9S7 2024-09-16T14:44:01.180 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.1AYksyoFSV is 10KB 2024-09-16T14:44:01.193 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.1AYksyoFSV 2024-09-16T14:44:01.195 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.tqlxMtf9S7 is 10KB 2024-09-16T14:44:01.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T14:44:01.210 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.tqlxMtf9S7 2024-09-16T14:44:01.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T14:44:01.255 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:44:01.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T14:44:01.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T14:44:01.270 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:44:01.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T14:44:01.270 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T14:44:01.322 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T14:44:01.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2024-09-16T14:44:01.361 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-16T14:44:01.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo update-grub 2024-09-16T14:44:02.584 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2024-09-16T14:44:02.585 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:44:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-16T14:44:02.713 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub' 2024-09-16T14:44:02.714 INFO:teuthology.orchestra.run.smithi116.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:44:02.721 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-16T14:44:02.767 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T14:44:02.773 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T14:44:02.895 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-16T14:44:02.901 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-16T14:44:03.044 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T14:44:03.049 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T14:44:03.085 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T14:44:03.090 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T14:44:03.137 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-16T14:44:03.142 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-16T14:44:03.182 INFO:teuthology.orchestra.run.smithi116.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-16T14:44:03.186 INFO:teuthology.orchestra.run.smithi116.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-16T14:44:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T14:44:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T14:44:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T14:44:03.205 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-16T14:44:03.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-16T14:44:03.333 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-16T14:44:03.333 INFO:teuthology.orchestra.run.smithi116.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-16T14:44:03.333 INFO:teuthology.orchestra.run.smithi116.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-16T14:44:03.346 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-16T14:44:03.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-16T14:44:33.253 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T14:44:33.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:44:33.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:44:33.364 INFO:teuthology.task.kernel:Checking client osd.3 for new kernel version... 2024-09-16T14:44:33.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:44:33.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:44:51.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-16T14:44:51.905 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-16T14:45:00.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:45:00.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:45:00.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:45:00.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:45:03.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-16T14:45:03.965 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-16T14:45:15.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:45:15.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:45:15.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:45:15.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:45:34.145 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-16T14:45:34.397 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-09-16T14:45:49.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:45:49.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:45:49.390 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-16T14:45:49.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:45:49.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:45:50.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:45:50.045 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-16T14:45:50.045 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-16T14:45:50.069 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-16T14:45:50.091 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-121-generic 2024-09-16T14:45:50.091 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T14:45:50.091 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T14:45:50.091 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T14:45:50.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:45:50.952 INFO:teuthology.task.kernel:Checking kernel version of osd.3, want "5.15.0-121-generic"... 2024-09-16T14:45:50.952 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-16T14:45:51.000 INFO:teuthology.orchestra.run.smithi116.stdout:5.15.0-121-generic 2024-09-16T14:45:51.000 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-16T14:45:51.000 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T14:45:51.000 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T14:45:51.092 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T14:45:51.093 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T14:45:51.163 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-09-16T14:45:51.197 DEBUG:teuthology.parallel:result is None 2024-09-16T14:45:52.001 INFO:teuthology.task.kernel:Enabling kdb on osd.3... 2024-09-16T14:45:52.002 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T14:45:52.070 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-16T14:45:52.093 DEBUG:teuthology.parallel:result is None 2024-09-16T14:45:52.094 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T14:45:52.102 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T14:45:52.103 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T14:45:52.105 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T14:45:52.111 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T14:45:52.247 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T14:45:52.418 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T14:45:52.419 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T14:45:52.421 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T14:45:52.486 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T14:45:52.617 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T14:45:52.617 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T14:45:52.619 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T14:45:52.645 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:45:52.650 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:45:52.653 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:45:52.660 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:45:52.662 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T14:45:52.701 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T14:45:52.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T14:45:52.708 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T14:45:52.728 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T14:45:52.824 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T14:45:52.824 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T14:45:52.826 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T14:45:52.832 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T14:45:52.875 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T14:45:52.924 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:45:52.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T14:45:52.997 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T14:45:53.003 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T14:45:53.052 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:45:53.052 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T14:45:53.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-16T14:45:53.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-16T14:45:53.195 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T14:45:53.203 INFO:teuthology.task.internal:Starting timer... 2024-09-16T14:45:53.203 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T14:45:53.334 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T14:45:53.426 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2024-09-16T14:45:53.426 DEBUG:teuthology.task.selinux:Excluding smithi116: OS 'ubuntu' does not support SELinux 2024-09-16T14:45:53.426 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T14:45:53.426 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T14:45:53.426 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T14:45:53.426 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T14:45:53.527 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T14:45:53.538 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T14:45:53.539 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T14:53:21.777 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2024-09-16T14:53:21.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:53:21.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:53:21.863 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-16T14:53:21.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-16T14:53:21.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:53:21.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:53:22.022 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-16T14:53:22.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-16T14:53:22.101 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T14:53:22.111 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T14:53:22.112 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T14:53:22.112 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:53:22.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T14:53:22.115 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Command line: ntpd -gq 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: ---------------------------------------------------- 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: corporation. Support and training for ntp-4 are 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: available at https://www.nwtime.org/support 2024-09-16T14:53:22.142 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: ---------------------------------------------------- 2024-09-16T14:53:22.143 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: proto: precision = 0.058 usec (-24) 2024-09-16T14:53:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: basedate set to 2022-02-04 2024-09-16T14:53:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: gps base set to 2022-02-06 (week 2196) 2024-09-16T14:53:22.144 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:53:22.144 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:53:22.145 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listen normally on 4 lo [::1]:123 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2024-09-16T14:53:22.146 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:22 ntpd[18494]: Listening on routing socket on fd #22 for interface updates 2024-09-16T14:53:22.171 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-16T14:53:22.171 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Command line: ntpd -gq 2024-09-16T14:53:22.171 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: ---------------------------------------------------- 2024-09-16T14:53:22.171 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: ntp-4 is maintained by Network Time Foundation, 2024-09-16T14:53:22.172 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-16T14:53:22.172 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: corporation. Support and training for ntp-4 are 2024-09-16T14:53:22.172 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: available at https://www.nwtime.org/support 2024-09-16T14:53:22.172 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: ---------------------------------------------------- 2024-09-16T14:53:22.172 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: proto: precision = 0.043 usec (-24) 2024-09-16T14:53:22.173 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: basedate set to 2022-02-04 2024-09-16T14:53:22.173 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: gps base set to 2022-02-06 (week 2196) 2024-09-16T14:53:22.173 INFO:teuthology.orchestra.run.smithi116.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:53:22.173 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:53:22.173 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:53:22.174 INFO:teuthology.orchestra.run.smithi116.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:53:22.174 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T14:53:22.175 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T14:53:22.175 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T14:53:22.175 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listen normally on 3 enp3s0f1 172.21.15.116:123 2024-09-16T14:53:22.175 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listen normally on 4 lo [::1]:123 2024-09-16T14:53:22.175 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:3f67%5]:123 2024-09-16T14:53:22.175 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:22 ntpd[18455]: Listening on routing socket on fd #22 for interface updates 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:23.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:23 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:24.142 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:24 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:24 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:24 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:24.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:24 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:25.142 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:25 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:25.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:25 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:25.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:25 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:25.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:25 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:25.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:25 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:25.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:25 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:26.142 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:26 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:26 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:26 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:26.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:26.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:26 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:27 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:27.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:27.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:27.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:27.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:27 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:28 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:28 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:28 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:28.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:28 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:28.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:28.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:28 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:29.143 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:29.144 INFO:teuthology.orchestra.run.smithi079.stdout:16 Sep 14:53:29 ntpd[18494]: ntpd: time slew -0.005257 s 2024-09-16T14:53:29.144 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.005257s 2024-09-16T14:53:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T14:53:29.144 INFO:teuthology.orchestra.run.smithi079.stderr:16 Sep 14:53:29 ntpd[18494]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T14:53:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:29 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:29 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:29.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:29 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:29.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:29 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:29.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:29 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:29.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:29 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:29.199 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:53:29.200 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-16T14:53:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:29.200 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:30.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:30.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:30.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:30.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:30 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:31.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:31 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:31.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:31 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:31.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:31 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:31.172 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:31 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:31.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:31 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:31.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:31 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:32.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:32.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:32.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:32.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:32.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:53:32.173 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:53:32.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:53:32.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:53:32.174 INFO:teuthology.orchestra.run.smithi116.stdout:16 Sep 14:53:32 ntpd[18455]: ntpd: time slew -0.000240 s 2024-09-16T14:53:32.174 INFO:teuthology.orchestra.run.smithi116.stdout:ntpd: time slew -0.000240s 2024-09-16T14:53:32.174 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T14:53:32.175 INFO:teuthology.orchestra.run.smithi116.stderr:16 Sep 14:53:32 ntpd[18455]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T14:53:32.229 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:53:32.229 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-09-16T14:53:32.229 INFO:teuthology.orchestra.run.smithi116.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:32.229 INFO:teuthology.orchestra.run.smithi116.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:32.229 INFO:teuthology.orchestra.run.smithi116.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:32.230 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-16T14:53:32.230 INFO:teuthology.run_tasks:Running task install... 2024-09-16T14:53:32.243 DEBUG:teuthology.task.install:project ceph 2024-09-16T14:53:32.243 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}} 2024-09-16T14:53:32.243 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'} 2024-09-16T14:53:32.243 INFO:teuthology.task.install:Using flavor: default 2024-09-16T14:53:32.249 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T14:53:32.249 INFO:teuthology.task.install:extra packages: [] 2024-09-16T14:53:32.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2024-09-16T14:53:32.250 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-key list | grep Ceph 2024-09-16T14:53:32.307 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T14:53:32.330 INFO:teuthology.orchestra.run.smithi116.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-16T14:53:32.333 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T14:53:32.333 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T14:53:32.334 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T14:53:32.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:53:32.359 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T14:53:32.359 INFO:teuthology.orchestra.run.smithi116.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T14:53:32.360 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T14:53:32.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:53:32.486 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default/ 2024-09-16T14:53:32.486 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:53:32.500 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default/ 2024-09-16T14:53:32.500 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:53:32.607 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:53:32.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T14:53:32.617 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:53:32.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T14:53:32.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo apt-get update 2024-09-16T14:53:32.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-16T14:53:32.803 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T14:53:32.804 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T14:53:32.813 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T14:53:32.825 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-16T14:53:32.830 INFO:teuthology.orchestra.run.smithi116.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T14:53:32.836 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-16T14:53:32.853 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-16T14:53:32.858 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T14:53:32.880 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-16T14:53:32.883 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T14:53:32.902 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-16T14:53:32.906 INFO:teuthology.orchestra.run.smithi116.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T14:53:32.924 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-16T14:53:32.927 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-09-16T14:53:32.945 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-09-16T14:53:32.951 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-16T14:53:32.954 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-09-16T14:53:32.972 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-09-16T14:53:33.152 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 28.8 kB in 0s (85.7 kB/s) 2024-09-16T14:53:33.177 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 28.8 kB in 0s (85.4 kB/s) 2024-09-16T14:53:34.114 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-09-16T14:53:34.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1jammy cephadm=18.2.4-845-ge4e227b3-1jammy ceph-mds=18.2.4-845-ge4e227b3-1jammy ceph-mgr=18.2.4-845-ge4e227b3-1jammy ceph-common=18.2.4-845-ge4e227b3-1jammy ceph-fuse=18.2.4-845-ge4e227b3-1jammy ceph-test=18.2.4-845-ge4e227b3-1jammy ceph-volume=18.2.4-845-ge4e227b3-1jammy radosgw=18.2.4-845-ge4e227b3-1jammy python3-rados=18.2.4-845-ge4e227b3-1jammy python3-rgw=18.2.4-845-ge4e227b3-1jammy python3-cephfs=18.2.4-845-ge4e227b3-1jammy python3-rbd=18.2.4-845-ge4e227b3-1jammy libcephfs2=18.2.4-845-ge4e227b3-1jammy libcephfs-dev=18.2.4-845-ge4e227b3-1jammy librados2=18.2.4-845-ge4e227b3-1jammy librbd1=18.2.4-845-ge4e227b3-1jammy rbd-fuse=18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:53:34.194 INFO:teuthology.orchestra.run.smithi116.stdout:Reading package lists... 2024-09-16T14:53:34.217 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-16T14:53:34.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1jammy cephadm=18.2.4-845-ge4e227b3-1jammy ceph-mds=18.2.4-845-ge4e227b3-1jammy ceph-mgr=18.2.4-845-ge4e227b3-1jammy ceph-common=18.2.4-845-ge4e227b3-1jammy ceph-fuse=18.2.4-845-ge4e227b3-1jammy ceph-test=18.2.4-845-ge4e227b3-1jammy ceph-volume=18.2.4-845-ge4e227b3-1jammy radosgw=18.2.4-845-ge4e227b3-1jammy python3-rados=18.2.4-845-ge4e227b3-1jammy python3-rgw=18.2.4-845-ge4e227b3-1jammy python3-cephfs=18.2.4-845-ge4e227b3-1jammy python3-rbd=18.2.4-845-ge4e227b3-1jammy libcephfs2=18.2.4-845-ge4e227b3-1jammy libcephfs-dev=18.2.4-845-ge4e227b3-1jammy librados2=18.2.4-845-ge4e227b3-1jammy librbd1=18.2.4-845-ge4e227b3-1jammy rbd-fuse=18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:53:34.296 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-16T14:53:34.404 INFO:teuthology.orchestra.run.smithi116.stdout:Building dependency tree... 2024-09-16T14:53:34.405 INFO:teuthology.orchestra.run.smithi116.stdout:Reading state information... 2024-09-16T14:53:34.507 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-16T14:53:34.508 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-16T14:53:34.602 INFO:teuthology.orchestra.run.smithi116.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:53:34.602 INFO:teuthology.orchestra.run.smithi116.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T14:53:34.603 INFO:teuthology.orchestra.run.smithi116.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T14:53:34.603 INFO:teuthology.orchestra.run.smithi116.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T14:53:34.603 INFO:teuthology.orchestra.run.smithi116.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T14:53:34.603 INFO:teuthology.orchestra.run.smithi116.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T14:53:34.603 INFO:teuthology.orchestra.run.smithi116.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:53:34.604 INFO:teuthology.orchestra.run.smithi116.stdout:The following additional packages will be installed: 2024-09-16T14:53:34.604 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T14:53:34.604 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T14:53:34.604 INFO:teuthology.orchestra.run.smithi116.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-16T14:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T14:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-16T14:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T14:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T14:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T14:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T14:53:34.606 INFO:teuthology.orchestra.run.smithi116.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout:Suggested packages: 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-16T14:53:34.607 INFO:teuthology.orchestra.run.smithi116.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-16T14:53:34.608 INFO:teuthology.orchestra.run.smithi116.stdout: python3-watchdog 2024-09-16T14:53:34.608 INFO:teuthology.orchestra.run.smithi116.stdout:Recommended packages: 2024-09-16T14:53:34.608 INFO:teuthology.orchestra.run.smithi116.stdout: btrfs-tools 2024-09-16T14:53:34.704 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:53:34.704 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-16T14:53:34.704 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-16T14:53:34.704 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-16T14:53:34.705 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-16T14:53:34.705 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-16T14:53:34.705 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:53:34.705 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-16T14:53:34.705 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T14:53:34.705 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-16T14:53:34.707 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-16T14:53:34.707 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-16T14:53:34.708 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T14:53:34.709 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-16T14:53:34.710 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-16T14:53:34.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-16T14:53:34.710 INFO:teuthology.orchestra.run.smithi079.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-16T14:53:34.710 INFO:teuthology.orchestra.run.smithi079.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-16T14:53:34.710 INFO:teuthology.orchestra.run.smithi079.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-16T14:53:34.710 INFO:teuthology.orchestra.run.smithi079.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-16T14:53:34.711 INFO:teuthology.orchestra.run.smithi079.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-16T14:53:34.711 INFO:teuthology.orchestra.run.smithi079.stdout: python3-watchdog 2024-09-16T14:53:34.711 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-16T14:53:34.711 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout:The following NEW packages will be installed: 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-16T14:53:34.712 INFO:teuthology.orchestra.run.smithi116.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T14:53:34.713 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-16T14:53:34.714 INFO:teuthology.orchestra.run.smithi116.stdout: socat xmlstarlet 2024-09-16T14:53:34.808 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-16T14:53:34.808 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T14:53:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T14:53:34.809 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-16T14:53:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-16T14:53:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-16T14:53:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-16T14:53:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-16T14:53:34.811 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-16T14:53:34.812 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-16T14:53:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-16T14:53:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-16T14:53:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-16T14:53:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-16T14:53:34.813 INFO:teuthology.orchestra.run.smithi079.stdout: socat xmlstarlet 2024-09-16T14:53:34.854 INFO:teuthology.orchestra.run.smithi116.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T14:53:34.855 INFO:teuthology.orchestra.run.smithi116.stdout:Need to get 163 MB of archives. 2024-09-16T14:53:34.855 INFO:teuthology.orchestra.run.smithi116.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-16T14:53:34.855 INFO:teuthology.orchestra.run.smithi116.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1jammy [3,451 kB] 2024-09-16T14:53:34.900 INFO:teuthology.orchestra.run.smithi116.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-16T14:53:34.950 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-16T14:53:34.951 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 163 MB of archives. 2024-09-16T14:53:34.951 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-16T14:53:34.951 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1jammy [3,451 kB] 2024-09-16T14:53:34.996 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-16T14:53:35.045 INFO:teuthology.orchestra.run.smithi116.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1jammy [3,108 kB] 2024-09-16T14:53:35.101 INFO:teuthology.orchestra.run.smithi116.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1jammy [683 kB] 2024-09-16T14:53:35.127 INFO:teuthology.orchestra.run.smithi116.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1jammy [357 kB] 2024-09-16T14:53:35.133 INFO:teuthology.orchestra.run.smithi116.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1jammy [32.8 kB] 2024-09-16T14:53:35.133 INFO:teuthology.orchestra.run.smithi116.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1jammy [180 kB] 2024-09-16T14:53:35.136 INFO:teuthology.orchestra.run.smithi116.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1jammy [63.7 kB] 2024-09-16T14:53:35.137 INFO:teuthology.orchestra.run.smithi116.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1jammy [333 kB] 2024-09-16T14:53:35.143 INFO:teuthology.orchestra.run.smithi116.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1jammy [5,934 kB] 2024-09-16T14:53:35.182 INFO:teuthology.orchestra.run.smithi116.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T14:53:35.230 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1jammy [3,108 kB] 2024-09-16T14:53:35.274 INFO:teuthology.orchestra.run.smithi116.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1jammy [112 kB] 2024-09-16T14:53:35.305 INFO:teuthology.orchestra.run.smithi116.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1jammy [445 kB] 2024-09-16T14:53:35.311 INFO:teuthology.orchestra.run.smithi116.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1jammy [22.0 MB] 2024-09-16T14:53:35.350 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1jammy [683 kB] 2024-09-16T14:53:35.354 INFO:teuthology.orchestra.run.smithi116.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T14:53:35.368 INFO:teuthology.orchestra.run.smithi116.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T14:53:35.382 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-16T14:53:35.399 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1jammy [357 kB] 2024-09-16T14:53:35.406 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1jammy [32.8 kB] 2024-09-16T14:53:35.407 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1jammy [180 kB] 2024-09-16T14:53:35.411 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1jammy [63.7 kB] 2024-09-16T14:53:35.413 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1jammy [333 kB] 2024-09-16T14:53:35.441 INFO:teuthology.orchestra.run.smithi116.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T14:53:35.455 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1jammy [5,934 kB] 2024-09-16T14:53:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-16T14:53:35.568 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-16T14:53:35.635 INFO:teuthology.orchestra.run.smithi116.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T14:53:35.640 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-16T14:53:35.645 INFO:teuthology.orchestra.run.smithi116.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T14:53:35.673 INFO:teuthology.orchestra.run.smithi116.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T14:53:35.681 INFO:teuthology.orchestra.run.smithi116.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T14:53:35.682 INFO:teuthology.orchestra.run.smithi116.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T14:53:35.683 INFO:teuthology.orchestra.run.smithi116.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T14:53:35.701 INFO:teuthology.orchestra.run.smithi116.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T14:53:35.702 INFO:teuthology.orchestra.run.smithi116.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T14:53:35.703 INFO:teuthology.orchestra.run.smithi116.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T14:53:35.717 INFO:teuthology.orchestra.run.smithi116.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T14:53:35.740 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1jammy [112 kB] 2024-09-16T14:53:35.743 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1jammy [445 kB] 2024-09-16T14:53:35.752 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1jammy [22.0 MB] 2024-09-16T14:53:35.787 INFO:teuthology.orchestra.run.smithi116.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T14:53:35.788 INFO:teuthology.orchestra.run.smithi116.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T14:53:35.788 INFO:teuthology.orchestra.run.smithi116.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T14:53:35.790 INFO:teuthology.orchestra.run.smithi116.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T14:53:35.790 INFO:teuthology.orchestra.run.smithi116.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T14:53:35.791 INFO:teuthology.orchestra.run.smithi116.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T14:53:35.796 INFO:teuthology.orchestra.run.smithi116.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T14:53:35.799 INFO:teuthology.orchestra.run.smithi116.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T14:53:35.800 INFO:teuthology.orchestra.run.smithi116.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T14:53:35.835 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-16T14:53:35.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-16T14:53:35.873 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-16T14:53:35.880 INFO:teuthology.orchestra.run.smithi116.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T14:53:35.881 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-16T14:53:35.881 INFO:teuthology.orchestra.run.smithi116.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T14:53:35.882 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-16T14:53:35.882 INFO:teuthology.orchestra.run.smithi116.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T14:53:35.883 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-16T14:53:35.901 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-16T14:53:35.902 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-16T14:53:35.903 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-16T14:53:35.919 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-16T14:53:35.938 INFO:teuthology.orchestra.run.smithi116.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1jammy [5,005 kB] 2024-09-16T14:53:35.938 INFO:teuthology.orchestra.run.smithi116.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T14:53:35.940 INFO:teuthology.orchestra.run.smithi116.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T14:53:35.942 INFO:teuthology.orchestra.run.smithi116.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T14:53:35.943 INFO:teuthology.orchestra.run.smithi116.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T14:53:35.961 INFO:teuthology.orchestra.run.smithi116.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T14:53:35.962 INFO:teuthology.orchestra.run.smithi116.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T14:53:35.962 INFO:teuthology.orchestra.run.smithi116.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T14:53:35.988 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-16T14:53:35.988 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-16T14:53:35.989 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-16T14:53:35.990 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-16T14:53:35.991 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-16T14:53:35.992 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-16T14:53:35.998 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-16T14:53:35.999 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-16T14:53:36.000 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-16T14:53:36.022 INFO:teuthology.orchestra.run.smithi116.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1jammy [241 kB] 2024-09-16T14:53:36.025 INFO:teuthology.orchestra.run.smithi116.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1jammy [130 kB] 2024-09-16T14:53:36.027 INFO:teuthology.orchestra.run.smithi116.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1jammy [1,494 kB] 2024-09-16T14:53:36.042 INFO:teuthology.orchestra.run.smithi116.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T14:53:36.045 INFO:teuthology.orchestra.run.smithi116.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T14:53:36.049 INFO:teuthology.orchestra.run.smithi116.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T14:53:36.050 INFO:teuthology.orchestra.run.smithi116.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T14:53:36.053 INFO:teuthology.orchestra.run.smithi116.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T14:53:36.054 INFO:teuthology.orchestra.run.smithi116.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T14:53:36.059 INFO:teuthology.orchestra.run.smithi116.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T14:53:36.072 INFO:teuthology.orchestra.run.smithi116.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1jammy [6,085 kB] 2024-09-16T14:53:36.082 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-16T14:53:36.083 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T14:53:36.084 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-16T14:53:36.085 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-16T14:53:36.088 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-16T14:53:36.090 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-16T14:53:36.091 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-16T14:53:36.101 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-16T14:53:36.124 INFO:teuthology.orchestra.run.smithi116.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T14:53:36.125 INFO:teuthology.orchestra.run.smithi116.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T14:53:36.130 INFO:teuthology.orchestra.run.smithi116.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T14:53:36.163 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-16T14:53:36.164 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-16T14:53:36.184 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-16T14:53:36.187 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-16T14:53:36.190 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-16T14:53:36.245 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-16T14:53:36.247 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-16T14:53:36.249 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-16T14:53:36.254 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-16T14:53:36.255 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-16T14:53:36.273 INFO:teuthology.orchestra.run.smithi116.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1jammy [22.4 MB] 2024-09-16T14:53:36.290 INFO:teuthology.orchestra.run.smithi116.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T14:53:36.292 INFO:teuthology.orchestra.run.smithi116.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T14:53:36.294 INFO:teuthology.orchestra.run.smithi116.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T14:53:36.294 INFO:teuthology.orchestra.run.smithi116.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T14:53:36.296 INFO:teuthology.orchestra.run.smithi116.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T14:53:36.296 INFO:teuthology.orchestra.run.smithi116.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T14:53:36.326 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-16T14:53:36.331 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-16T14:53:36.332 INFO:teuthology.orchestra.run.smithi116.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T14:53:36.337 INFO:teuthology.orchestra.run.smithi116.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T14:53:36.337 INFO:teuthology.orchestra.run.smithi116.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T14:53:36.375 INFO:teuthology.orchestra.run.smithi116.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T14:53:36.421 INFO:teuthology.orchestra.run.smithi116.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T14:53:36.425 INFO:teuthology.orchestra.run.smithi116.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T14:53:36.426 INFO:teuthology.orchestra.run.smithi116.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T14:53:36.453 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-16T14:53:36.483 INFO:teuthology.orchestra.run.smithi116.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T14:53:36.483 INFO:teuthology.orchestra.run.smithi116.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T14:53:36.485 INFO:teuthology.orchestra.run.smithi116.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T14:53:36.486 INFO:teuthology.orchestra.run.smithi116.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T14:53:36.487 INFO:teuthology.orchestra.run.smithi116.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T14:53:36.488 INFO:teuthology.orchestra.run.smithi116.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T14:53:36.491 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-16T14:53:36.494 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-16T14:53:36.495 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-16T14:53:36.497 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-16T14:53:36.498 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-16T14:53:36.498 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-16T14:53:36.537 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T14:53:36.538 INFO:teuthology.orchestra.run.smithi116.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T14:53:36.538 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-16T14:53:36.539 INFO:teuthology.orchestra.run.smithi116.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T14:53:36.545 INFO:teuthology.orchestra.run.smithi116.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T14:53:36.572 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-16T14:53:36.616 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1jammy [5,005 kB] 2024-09-16T14:53:36.619 INFO:teuthology.orchestra.run.smithi116.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T14:53:36.623 INFO:teuthology.orchestra.run.smithi116.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T14:53:36.624 INFO:teuthology.orchestra.run.smithi116.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T14:53:36.633 INFO:teuthology.orchestra.run.smithi116.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T14:53:36.635 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-16T14:53:36.639 INFO:teuthology.orchestra.run.smithi116.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T14:53:36.640 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-16T14:53:36.641 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-16T14:53:36.649 INFO:teuthology.orchestra.run.smithi116.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T14:53:36.657 INFO:teuthology.orchestra.run.smithi116.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T14:53:36.679 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-16T14:53:36.679 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-16T14:53:36.681 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-16T14:53:36.682 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-16T14:53:36.682 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-16T14:53:36.683 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-16T14:53:36.701 INFO:teuthology.orchestra.run.smithi116.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T14:53:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1jammy [241 kB] 2024-09-16T14:53:36.705 INFO:teuthology.orchestra.run.smithi116.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T14:53:36.709 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1jammy [130 kB] 2024-09-16T14:53:36.712 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1jammy [1,494 kB] 2024-09-16T14:53:36.720 INFO:teuthology.orchestra.run.smithi116.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T14:53:36.735 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-16T14:53:36.735 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-16T14:53:36.742 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-16T14:53:36.761 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1jammy [6,085 kB] 2024-09-16T14:53:36.782 INFO:teuthology.orchestra.run.smithi116.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T14:53:36.784 INFO:teuthology.orchestra.run.smithi116.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T14:53:36.816 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-16T14:53:36.820 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-16T14:53:36.821 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-16T14:53:36.829 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-16T14:53:36.835 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-16T14:53:36.845 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-16T14:53:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T14:53:36.898 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-16T14:53:36.902 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-16T14:53:36.917 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-16T14:53:36.968 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1jammy [22.4 MB] 2024-09-16T14:53:36.979 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-16T14:53:36.981 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-16T14:53:37.042 INFO:teuthology.orchestra.run.smithi116.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1jammy [14.1 kB] 2024-09-16T14:53:37.043 INFO:teuthology.orchestra.run.smithi116.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1jammy [834 kB] 2024-09-16T14:53:37.059 INFO:teuthology.orchestra.run.smithi116.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1jammy [2,159 kB] 2024-09-16T14:53:37.096 INFO:teuthology.orchestra.run.smithi116.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1jammy [240 kB] 2024-09-16T14:53:37.099 INFO:teuthology.orchestra.run.smithi116.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1jammy [145 kB] 2024-09-16T14:53:37.101 INFO:teuthology.orchestra.run.smithi116.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1jammy [2,233 kB] 2024-09-16T14:53:37.153 INFO:teuthology.orchestra.run.smithi116.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1jammy [8,625 kB] 2024-09-16T14:53:37.434 INFO:teuthology.orchestra.run.smithi116.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1jammy [14.3 kB] 2024-09-16T14:53:37.435 INFO:teuthology.orchestra.run.smithi116.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1jammy [42.8 MB] 2024-09-16T14:53:37.800 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1jammy [14.1 kB] 2024-09-16T14:53:37.801 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1jammy [834 kB] 2024-09-16T14:53:37.818 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1jammy [2,159 kB] 2024-09-16T14:53:37.857 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1jammy [240 kB] 2024-09-16T14:53:37.860 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1jammy [145 kB] 2024-09-16T14:53:37.862 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1jammy [2,233 kB] 2024-09-16T14:53:37.932 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1jammy [8,625 kB] 2024-09-16T14:53:38.232 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1jammy [14.3 kB] 2024-09-16T14:53:38.236 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1jammy [42.8 MB] 2024-09-16T14:53:38.976 INFO:teuthology.orchestra.run.smithi116.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1jammy [122 kB] 2024-09-16T14:53:38.979 INFO:teuthology.orchestra.run.smithi116.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1jammy [38.3 kB] 2024-09-16T14:53:38.980 INFO:teuthology.orchestra.run.smithi116.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1jammy [11.7 MB] 2024-09-16T14:53:39.348 INFO:teuthology.orchestra.run.smithi116.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1jammy [93.1 kB] 2024-09-16T14:53:39.920 INFO:teuthology.orchestra.run.smithi116.stdout:Fetched 163 MB in 5s (35.1 MB/s) 2024-09-16T14:53:40.049 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-16T14:53:40.133 INFO:teuthology.orchestra.run.smithi116.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T14:53:40.138 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-16T14:53:40.206 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1jammy [122 kB] 2024-09-16T14:53:40.206 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T14:53:40.313 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1jammy [38.3 kB] 2024-09-16T14:53:40.314 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1jammy [11.7 MB] 2024-09-16T14:53:40.485 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T14:53:40.511 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T14:53:40.551 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T14:53:40.687 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1jammy [93.1 kB] 2024-09-16T14:53:40.913 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T14:53:40.939 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T14:53:40.979 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T14:53:41.264 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 163 MB in 6s (27.7 MB/s) 2024-09-16T14:53:41.307 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T14:53:41.334 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T14:53:41.374 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T14:53:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-16T14:53:41.474 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-16T14:53:41.480 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-16T14:53:41.566 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T14:53:41.744 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T14:53:41.771 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T14:53:41.819 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:53:41.886 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-16T14:53:41.912 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-16T14:53:41.944 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T14:53:42.189 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T14:53:42.215 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T14:53:42.255 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:53:42.256 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T14:53:42.283 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-16T14:53:42.323 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T14:53:42.591 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T14:53:42.618 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T14:53:42.642 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T14:53:42.658 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:53:42.669 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-16T14:53:42.709 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T14:53:42.953 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T14:53:42.968 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T14:53:43.011 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T14:53:43.129 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T14:53:43.156 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T14:53:43.204 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:53:43.322 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librados2. 2024-09-16T14:53:43.348 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:43.389 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:43.607 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T14:53:43.633 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T14:53:43.665 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:53:43.808 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librbd1. 2024-09-16T14:53:43.834 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../009-librbd1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:43.874 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:44.002 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T14:53:44.028 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-16T14:53:44.068 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:53:44.304 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T14:53:44.331 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:44.371 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:44.405 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-16T14:53:44.431 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-16T14:53:44.471 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T14:53:44.791 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2024-09-16T14:53:44.807 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rados. 2024-09-16T14:53:44.817 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:44.833 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../011-python3-rados_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:44.857 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:44.873 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:45.193 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T14:53:45.219 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:53:45.259 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:45.277 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2024-09-16T14:53:45.307 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-librbd1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:45.335 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:45.503 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T14:53:45.530 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:45.562 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:45.788 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T14:53:45.814 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:45.831 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T14:53:45.854 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:45.857 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:53:45.900 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:46.132 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2024-09-16T14:53:46.147 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python3-rados_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:46.190 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:46.192 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T14:53:46.219 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T14:53:46.259 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T14:53:46.512 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T14:53:46.536 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:53:46.576 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:46.578 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T14:53:46.605 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T14:53:46.645 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T14:53:46.812 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T14:53:46.827 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:46.862 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:46.906 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T14:53:46.932 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:46.972 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:47.157 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T14:53:47.182 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:53:47.223 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:47.242 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T14:53:47.268 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T14:53:47.300 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T14:53:47.543 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T14:53:47.569 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-16T14:53:47.609 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T14:53:47.661 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package librgw2. 2024-09-16T14:53:47.688 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:47.727 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:47.929 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T14:53:47.955 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-16T14:53:47.995 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-16T14:53:48.247 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T14:53:48.256 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T14:53:48.271 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:48.273 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:48.306 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:48.314 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:48.616 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T14:53:48.642 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T14:53:48.643 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T14:53:48.669 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-16T14:53:48.683 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T14:53:48.709 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T14:53:48.944 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T14:53:48.970 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:49.010 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:49.062 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2024-09-16T14:53:49.088 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:49.128 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:49.631 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-common. 2024-09-16T14:53:49.648 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T14:53:49.658 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:49.674 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:49.697 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:49.714 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:50.034 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-16T14:53:50.060 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-16T14:53:50.100 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T14:53:50.411 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T14:53:50.437 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:50.478 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:50.865 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2024-09-16T14:53:50.891 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:50.931 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:50.970 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-base. 2024-09-16T14:53:50.996 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:51.045 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:51.624 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T14:53:51.650 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T14:53:51.690 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T14:53:51.943 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T14:53:51.967 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T14:53:52.001 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T14:53:52.220 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2024-09-16T14:53:52.246 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:53:52.271 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T14:53:52.286 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T14:53:52.296 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:53:52.321 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T14:53:52.590 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T14:53:52.624 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T14:53:52.657 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T14:53:52.908 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-16T14:53:52.934 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-16T14:53:52.959 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T14:53:52.974 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-16T14:53:52.986 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T14:53:53.026 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T14:53:53.277 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2024-09-16T14:53:53.303 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-16T14:53:53.312 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T14:53:53.339 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T14:53:53.343 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T14:53:53.379 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T14:53:53.623 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-portend. 2024-09-16T14:53:53.638 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-16T14:53:53.672 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-16T14:53:53.673 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T14:53:53.698 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-16T14:53:53.738 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-16T14:53:53.951 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T14:53:53.974 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T14:53:53.999 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-16T14:53:54.017 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T14:53:54.025 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-16T14:53:54.058 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-16T14:53:54.320 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T14:53:54.347 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T14:53:54.360 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-16T14:53:54.386 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-16T14:53:54.387 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T14:53:54.427 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-16T14:53:54.730 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2024-09-16T14:53:54.756 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-16T14:53:54.796 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-16T14:53:54.915 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T14:53:54.942 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T14:53:54.982 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T14:53:55.099 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2024-09-16T14:53:55.125 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-16T14:53:55.166 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-16T14:53:55.310 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T14:53:55.336 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T14:53:55.376 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T14:53:55.452 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-16T14:53:55.478 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-16T14:53:55.519 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-16T14:53:55.654 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T14:53:55.670 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T14:53:55.706 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T14:53:56.008 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-mako. 2024-09-16T14:53:56.034 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T14:53:56.073 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T14:53:56.113 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T14:53:56.139 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-16T14:53:56.179 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-16T14:53:56.418 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T14:53:56.445 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T14:53:56.485 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:53:56.569 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T14:53:56.595 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-16T14:53:56.635 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-16T14:53:56.796 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T14:53:56.823 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T14:53:56.863 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T14:53:56.914 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T14:53:56.929 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-16T14:53:56.963 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-16T14:53:57.115 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webob. 2024-09-16T14:53:57.133 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T14:53:57.165 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T14:53:57.275 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T14:53:57.301 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-16T14:53:57.342 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-16T14:53:57.476 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T14:53:57.503 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T14:53:57.538 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T14:53:57.653 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2024-09-16T14:53:57.680 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-16T14:53:57.720 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T14:53:57.821 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T14:53:57.848 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T14:53:57.888 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T14:53:58.040 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T14:53:58.066 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T14:53:58.107 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:53:58.190 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-paste. 2024-09-16T14:53:58.217 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T14:53:58.257 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T14:53:58.410 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T14:53:58.436 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-16T14:53:58.476 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-16T14:53:58.543 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T14:53:58.559 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T14:53:58.601 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T14:53:58.754 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2024-09-16T14:53:58.781 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-16T14:53:58.821 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T14:53:58.904 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T14:53:58.931 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T14:53:58.971 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T14:53:59.158 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T14:53:59.184 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-16T14:53:59.227 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T14:53:59.274 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T14:53:59.300 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T14:53:59.340 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T14:53:59.511 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T14:53:59.538 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-16T14:53:59.577 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T14:53:59.626 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T14:53:59.653 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T14:53:59.693 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T14:53:59.881 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2024-09-16T14:53:59.906 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-16T14:53:59.947 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T14:54:00.131 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T14:54:00.159 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T14:54:00.189 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T14:54:00.276 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T14:54:00.302 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-16T14:54:00.342 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T14:54:00.492 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-idna. 2024-09-16T14:54:00.519 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T14:54:00.559 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T14:54:00.603 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T14:54:00.630 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-16T14:54:00.670 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-16T14:54:00.895 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T14:54:00.922 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T14:54:00.948 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T14:54:00.961 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T14:54:00.974 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-16T14:54:01.015 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-16T14:54:01.282 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests. 2024-09-16T14:54:01.308 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T14:54:01.327 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T14:54:01.348 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T14:54:01.353 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-16T14:54:01.393 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T14:54:01.659 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T14:54:01.686 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T14:54:01.725 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T14:54:01.748 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2024-09-16T14:54:01.775 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-16T14:54:01.815 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-16T14:54:02.012 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T14:54:02.027 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:02.070 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:02.143 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2024-09-16T14:54:02.169 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-16T14:54:02.210 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T14:54:02.400 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T14:54:02.427 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:02.466 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:02.521 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2024-09-16T14:54:02.547 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-16T14:54:02.587 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T14:54:02.786 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T14:54:02.812 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T14:54:02.852 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T14:54:02.884 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2024-09-16T14:54:02.910 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-16T14:54:02.950 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T14:54:03.164 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T14:54:03.191 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T14:54:03.230 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T14:54:03.253 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T14:54:03.268 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-16T14:54:03.311 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T14:54:03.525 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T14:54:03.551 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:03.583 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:03.597 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T14:54:03.613 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:03.656 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:03.945 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T14:54:03.971 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:04.011 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:04.036 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T14:54:04.063 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:04.103 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:04.389 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T14:54:04.416 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-16T14:54:04.447 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-16T14:54:04.598 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T14:54:04.625 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:04.664 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:04.717 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T14:54:04.744 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-16T14:54:04.784 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-16T14:54:05.121 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T14:54:05.147 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:05.187 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:05.582 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T14:54:05.609 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:05.649 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:05.676 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph. 2024-09-16T14:54:05.702 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../060-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:05.734 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:06.020 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T14:54:06.046 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:06.087 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:06.236 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T14:54:06.262 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:06.302 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:06.440 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T14:54:06.466 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:06.506 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:06.876 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package cephadm. 2024-09-16T14:54:06.903 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../063-cephadm_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:06.942 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:07.178 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T14:54:07.194 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T14:54:07.228 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T14:54:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2024-09-16T14:54:07.396 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-ceph_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:07.439 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:07.548 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T14:54:07.564 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T14:54:07.598 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:07.751 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T14:54:07.777 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:07.809 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:08.179 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T14:54:08.206 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:08.246 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:08.624 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2024-09-16T14:54:08.650 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-cephadm_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:09.002 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T14:54:09.029 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-16T14:54:09.069 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-16T14:54:09.320 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-babel. 2024-09-16T14:54:09.347 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T14:54:09.380 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-16T14:54:09.386 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:09.396 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T14:54:09.438 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:09.723 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T14:54:09.749 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T14:54:09.789 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T14:54:10.134 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T14:54:10.161 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:10.392 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:10.444 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2024-09-16T14:54:10.472 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-16T14:54:10.502 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:10.763 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T14:54:10.789 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T14:54:10.829 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T14:54:10.831 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T14:54:10.857 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-16T14:54:10.897 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T14:54:11.099 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-py. 2024-09-16T14:54:11.125 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-16T14:54:11.157 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T14:54:11.251 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T14:54:11.278 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:11.318 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:11.494 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T14:54:11.521 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T14:54:11.560 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T14:54:11.656 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T14:54:11.682 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-16T14:54:11.721 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-16T14:54:11.830 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-toml. 2024-09-16T14:54:11.857 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-16T14:54:11.888 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T14:54:12.009 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2024-09-16T14:54:12.035 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-16T14:54:12.066 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-16T14:54:12.199 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T14:54:12.226 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T14:54:12.265 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T14:54:12.362 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-16T14:54:12.389 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-16T14:54:12.429 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-16T14:54:12.561 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T14:54:12.587 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T14:54:12.619 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T14:54:12.732 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2024-09-16T14:54:12.759 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-16T14:54:12.798 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-16T14:54:12.897 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-routes. 2024-09-16T14:54:12.924 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T14:54:12.964 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T14:54:13.086 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T14:54:13.112 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-16T14:54:13.152 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T14:54:13.276 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T14:54:13.303 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:13.351 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:13.480 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T14:54:13.508 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T14:54:13.546 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T14:54:13.817 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2024-09-16T14:54:13.843 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-16T14:54:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T14:54:14.220 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T14:54:14.247 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:14.287 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:14.555 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T14:54:14.571 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T14:54:14.605 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T14:54:15.050 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T14:54:15.065 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T14:54:15.100 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T14:54:15.454 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T14:54:15.481 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T14:54:15.520 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T14:54:15.668 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-16T14:54:15.684 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-16T14:54:15.726 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T14:54:15.807 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T14:54:15.833 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T14:54:15.873 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T14:54:16.205 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T14:54:16.231 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-16T14:54:16.271 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T14:54:16.623 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T14:54:16.651 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:16.689 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:16.701 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-16T14:54:16.727 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-16T14:54:16.767 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-16T14:54:17.037 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T14:54:17.064 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-16T14:54:17.103 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T14:54:17.634 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T14:54:17.661 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T14:54:17.700 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T14:54:17.813 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T14:54:17.840 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:17.902 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:18.055 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T14:54:18.082 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T14:54:18.113 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T14:54:18.433 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T14:54:18.460 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T14:54:18.499 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T14:54:18.811 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T14:54:18.838 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-16T14:54:18.841 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T14:54:18.868 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-16T14:54:18.877 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T14:54:18.907 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-16T14:54:19.206 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T14:54:19.233 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T14:54:19.273 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T14:54:19.295 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T14:54:19.323 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-16T14:54:19.362 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-16T14:54:19.576 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T14:54:19.603 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T14:54:19.642 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T14:54:19.682 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T14:54:19.709 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-16T14:54:19.757 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T14:54:19.911 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T14:54:19.927 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T14:54:19.961 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T14:54:20.019 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T14:54:20.035 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-16T14:54:20.069 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-16T14:54:20.265 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T14:54:20.292 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T14:54:20.331 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T14:54:20.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T14:54:20.375 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-16T14:54:20.406 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-16T14:54:20.726 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T14:54:20.753 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-16T14:54:20.793 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T14:54:21.105 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T14:54:21.131 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-16T14:54:21.171 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-16T14:54:21.203 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T14:54:21.219 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:21.253 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:21.508 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T14:54:21.535 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-16T14:54:21.556 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T14:54:21.583 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T14:54:21.583 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T14:54:21.614 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T14:54:21.934 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T14:54:21.961 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T14:54:22.000 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T14:54:22.256 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T14:54:22.261 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package jq. 2024-09-16T14:54:22.272 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:22.277 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T14:54:22.314 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:22.319 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T14:54:22.558 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package socat. 2024-09-16T14:54:22.585 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T14:54:22.616 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T14:54:22.642 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T14:54:22.669 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-16T14:54:22.709 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T14:54:22.911 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T14:54:22.927 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T14:54:22.969 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T14:54:23.012 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T14:54:23.040 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T14:54:23.078 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T14:54:23.281 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-test. 2024-09-16T14:54:23.297 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../096-ceph-test_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:23.331 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:24.025 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2024-09-16T14:54:24.025 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-16T14:54:24.026 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-16T14:54:24.026 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2024-09-16T14:54:24.026 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-16T14:54:24.026 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-16T14:54:24.037 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T14:54:24.065 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-16T14:54:24.104 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-16T14:54:24.459 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2024-09-16T14:54:24.483 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-ceph-test_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:24.525 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:25.135 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T14:54:25.151 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:25.185 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:25.447 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T14:54:25.463 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:25.497 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:25.842 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T14:54:25.869 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T14:54:25.908 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T14:54:26.263 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T14:54:26.279 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T14:54:26.313 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T14:54:26.446 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T14:54:26.475 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-845-ge4e227b3-1jammy_all.deb ... 2024-09-16T14:54:26.513 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:26.867 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T14:54:26.894 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T14:54:26.933 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T14:54:27.228 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T14:54:27.244 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T14:54:27.259 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T14:54:27.286 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T14:54:27.286 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:27.325 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:27.606 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T14:54:27.633 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T14:54:27.672 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T14:54:27.704 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T14:54:27.731 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-16T14:54:27.770 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T14:54:28.101 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T14:54:28.117 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-16T14:54:28.151 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T14:54:28.159 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-16T14:54:28.179 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T14:54:28.218 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T14:54:28.529 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T14:54:28.557 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T14:54:28.563 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T14:54:28.591 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T14:54:28.596 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T14:54:28.629 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T14:54:28.881 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T14:54:28.909 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T14:54:28.947 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T14:54:28.966 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T14:54:28.994 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-16T14:54:29.033 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-16T14:54:29.361 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2024-09-16T14:54:29.389 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-16T14:54:29.427 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T14:54:29.660 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package radosgw. 2024-09-16T14:54:29.688 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../107-radosgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:29.726 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:29.848 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T14:54:29.876 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-16T14:54:29.906 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-16T14:54:30.210 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T14:54:30.238 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-16T14:54:30.276 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-16T14:54:30.429 INFO:teuthology.orchestra.run.smithi116.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T14:54:30.457 INFO:teuthology.orchestra.run.smithi116.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:30.495 INFO:teuthology.orchestra.run.smithi116.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:30.546 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T14:54:30.574 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-16T14:54:30.612 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-16T14:54:30.799 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T14:54:31.050 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T14:54:31.176 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T14:54:31.358 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2024-09-16T14:54:31.386 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-radosgw_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:31.425 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:31.444 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T14:54:31.802 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T14:54:32.225 INFO:teuthology.orchestra.run.smithi116.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T14:54:32.253 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T14:54:32.281 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-845-ge4e227b3-1jammy_amd64.deb ... 2024-09-16T14:54:32.295 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:32.319 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:32.607 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-16T14:54:32.777 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user cephadm....done 2024-09-16T14:54:32.866 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-16T14:54:32.901 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T14:54:32.993 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-16T14:54:33.177 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T14:54:33.253 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-16T14:54:33.428 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T14:54:33.529 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T14:54:33.566 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-16T14:54:33.755 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T14:54:33.973 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-16T14:54:34.015 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T14:54:34.044 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:34.124 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T14:54:34.434 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T14:54:34.553 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2024-09-16T14:54:34.709 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-16T14:54:34.794 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T14:54:34.994 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-16T14:54:35.037 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T14:54:35.237 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-16T14:54:35.297 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T14:54:35.338 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-16T14:54:35.531 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T14:54:35.598 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T14:54:35.782 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T14:54:35.859 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-16T14:54:35.986 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-16T14:54:36.033 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:36.262 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-16T14:54:36.424 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T14:54:36.598 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-16T14:54:36.835 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T14:54:36.857 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-16T14:54:37.095 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T14:54:37.142 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-16T14:54:37.195 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T14:54:37.402 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-16T14:54:37.547 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:37.648 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T14:54:37.661 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-16T14:54:37.907 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T14:54:37.912 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:38.164 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-16T14:54:38.175 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T14:54:38.290 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-16T14:54:38.493 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T14:54:38.649 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-16T14:54:38.775 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-16T14:54:39.152 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:39.178 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T14:54:39.269 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-16T14:54:39.429 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T14:54:39.521 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-16T14:54:39.530 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T14:54:39.648 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T14:54:39.780 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-16T14:54:39.941 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T14:54:40.098 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-16T14:54:40.325 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T14:54:40.576 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T14:54:40.792 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-16T14:54:41.011 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T14:54:41.043 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-16T14:54:41.144 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-16T14:54:41.271 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-16T14:54:41.279 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T14:54:41.572 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-16T14:54:41.613 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T14:54:41.881 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T14:54:41.965 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-16T14:54:42.008 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:42.216 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-16T14:54:42.309 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T14:54:42.601 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-16T14:54:42.626 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T14:54:42.886 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-16T14:54:43.221 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-16T14:54:43.472 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-16T14:54:43.598 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:43.832 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:54:43.891 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-16T14:54:43.992 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T14:54:44.225 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-16T14:54:44.251 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T14:54:44.393 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T14:54:44.503 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T14:54:44.787 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T14:54:45.022 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T14:54:45.273 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:54:45.382 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:54:45.399 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T14:54:45.516 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-16T14:54:45.525 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T14:54:45.767 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-16T14:54:45.835 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T14:54:45.885 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-16T14:54:45.986 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-16T14:54:46.094 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T14:54:46.263 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-16T14:54:46.345 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T14:54:46.531 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-16T14:54:46.588 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:54:46.815 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:54:46.822 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T14:54:46.941 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-16T14:54:47.065 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T14:54:47.077 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-16T14:54:47.191 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T14:54:47.369 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-16T14:54:47.484 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T14:54:47.610 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T14:54:47.612 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-16T14:54:47.863 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-16T14:54:47.894 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T14:54:48.123 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:54:48.178 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T14:54:48.374 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-16T14:54:48.413 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:48.659 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-16T14:54:48.785 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-16T14:54:48.795 INFO:teuthology.orchestra.run.smithi116.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T14:54:49.033 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T14:54:49.069 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-16T14:54:49.159 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T14:54:49.195 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-16T14:54:49.488 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-16T14:54:49.568 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T14:54:49.789 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-16T14:54:49.819 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T14:54:50.053 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:54:50.057 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-16T14:54:50.163 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T14:54:50.471 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-16T14:54:50.472 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T14:54:50.735 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-16T14:54:50.769 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T14:54:50.862 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-16T14:54:51.042 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T14:54:51.167 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T14:54:51.246 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-16T14:54:51.444 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T14:54:51.514 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-16T14:54:51.711 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T14:54:51.774 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-16T14:54:51.900 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-16T14:54:52.121 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T14:54:52.226 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-16T14:54:52.497 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T14:54:52.519 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-16T14:54:52.779 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-16T14:54:52.782 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T14:54:52.905 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-16T14:54:53.134 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T14:54:53.181 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-16T14:54:53.260 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:53.369 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:53.457 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-16T14:54:53.478 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:53.588 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:53.714 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:53.767 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-16T14:54:53.925 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T14:54:54.135 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T14:54:54.218 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:54.328 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:54.403 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-16T14:54:54.437 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:54.638 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:54:54.638 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:54:54.756 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-16T14:54:54.882 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.008 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.130 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.134 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.231 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.252 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.358 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T14:54:55.361 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.556 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-16T14:54:55.858 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:55.959 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.085 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.296 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:54:56.296 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:54:56.578 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.688 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.754 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.814 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.880 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:56.939 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:57.006 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-16T14:54:57.074 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:57.642 INFO:teuthology.orchestra.run.smithi116.stdout:Adding group ceph....done 2024-09-16T14:54:57.960 INFO:teuthology.orchestra.run.smithi116.stdout:Adding system user ceph....done 2024-09-16T14:54:58.137 INFO:teuthology.orchestra.run.smithi116.stdout:Setting system user ceph properties....done 2024-09-16T14:54:58.157 INFO:teuthology.orchestra.run.smithi116.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T14:54:58.194 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:58.291 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T14:54:58.303 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:58.430 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:58.556 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:58.601 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T14:54:58.682 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:59.075 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:59.193 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2024-09-16T14:54:59.201 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:54:59.544 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2024-09-16T14:54:59.664 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:54:59.664 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:54:59.713 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2024-09-16T14:54:59.727 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T14:54:59.860 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T14:55:00.158 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T14:55:00.195 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:00.557 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T14:55:00.609 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:00.736 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:01.014 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:01.177 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:55:01.177 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:55:01.245 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:55:01.245 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:55:01.621 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:01.683 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:01.889 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:55:01.889 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:55:01.963 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T14:55:02.431 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:02.651 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:02.684 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:55:02.685 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:55:02.940 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:55:02.940 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:55:03.133 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:03.354 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:55:03.354 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:55:03.424 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:03.550 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:03.701 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:03.835 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:03.912 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:55:03.912 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:55:04.116 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:55:04.116 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:55:04.402 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:04.553 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:04.570 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:04.679 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:04.696 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:04.822 INFO:teuthology.orchestra.run.smithi116.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:04.847 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:05.057 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:55:05.057 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:55:05.183 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T14:55:05.565 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:05.716 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:05.843 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:05.985 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1jammy) ... 2024-09-16T14:55:06.267 INFO:teuthology.orchestra.run.smithi116.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T14:55:06.322 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-16T14:55:06.725 INFO:teuthology.orchestra.run.smithi116.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T14:55:06.732 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:07.532 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-16T14:55:08.017 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T14:55:08.022 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:08.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:55:08.185 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2024-09-16T14:55:08.203 INFO:teuthology.orchestra.run.smithi079.stdout:18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:55:08.204 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:55:08.204 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1jammy is installed. 2024-09-16T14:55:08.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:55:08.346 DEBUG:teuthology.orchestra.run.smithi116:> dpkg-query -W -f '${Version}' ceph 2024-09-16T14:55:08.365 INFO:teuthology.orchestra.run.smithi116.stdout:18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:55:08.365 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1jammy 2024-09-16T14:55:08.365 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1jammy is installed. 2024-09-16T14:55:08.367 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T14:55:08.368 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:08.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T14:55:08.382 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:08.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T14:55:08.423 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T14:55:08.424 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:08.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T14:55:08.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T14:55:08.494 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:08.494 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T14:55:08.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T14:55:08.560 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T14:55:08.561 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:08.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T14:55:08.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T14:55:08.629 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:08.629 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T14:55:08.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T14:55:08.697 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T14:55:08.698 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:08.698 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T14:55:08.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T14:55:08.765 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:08.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T14:55:08.779 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T14:55:08.834 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T14:55:08.919 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T14:55:08.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-09-16T14:55:08.923 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-09-16T14:55:08.937 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T14:55:08.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T14:55:08.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T14:55:08.993 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T14:55:08.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T14:55:09.031 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T14:55:09.058 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T14:55:09.058 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-16T14:55:09.059 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772', 'branch': 'reef', 'description': 'rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906772', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 931, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'], ['osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 1390, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'sleep_before_teardown': 0, 'subset': '5319/100000', 'suite': 'rados', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6', 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPFNVjQ2LyC42LG7xQsU3/I8r5yZfpAhZ1FK4OFh8kkRFAuv531W3vm/9rqgtcTS/rzddCJQkc63/wgC/jj2lo=', 'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHD/taT2s04WI14GJXRfEo6k+zPS3egS9TYPQgNYSihkXzuEt6jGAsjtRRNaqG4waPS1a7j8ghXsYL3CdV5xp3M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'mon_bind_msgr2': False, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'cluster': 'ceph'}}, {'full_sequential': [{'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33', 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33', 'sudo ceph osd pool create test 16 16', 'sudo ceph osd pool set test size 3', 'sudo ceph pg dump pgs --format=json-pretty']}}, {'radosbench': {'clients': ['client.0'], 'create_pool': False, 'objectsize': 1048576, 'pool': 'test', 'time': 360, 'type': 'rand'}}, {'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0', 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0']}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_22:00:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T14:55:09.059 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T14:55:09.087 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T14:55:09.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T14:55:09.135 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T14:55:09.154 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:09.154 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T14:55:09.194 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T14:55:09.194 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-16T14:55:09.242 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T14:55:09.242 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:09.242 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-16T14:55:09.242 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:09.243 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-16 14:49:51.526160621 +0000 2024-09-16T14:55:09.243 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-16 14:49:51.274153801 +0000 2024-09-16T14:55:09.243 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-16 14:49:51.274153801 +0000 2024-09-16T14:55:09.243 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-16T14:55:09.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T14:55:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-16T14:55:09.297 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-16T14:55:09.298 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000462723 s, 1.1 MB/s 2024-09-16T14:55:09.299 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T14:55:09.347 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-16 14:49:52.010173707 +0000 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-16 14:49:51.758166901 +0000 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-16 14:49:51.758166901 +0000 2024-09-16T14:55:09.394 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-16T14:55:09.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T14:55:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-16T14:55:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-16T14:55:09.450 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000319796 s, 1.6 MB/s 2024-09-16T14:55:09.451 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T14:55:09.510 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-16T14:55:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T14:55:09.558 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:09.558 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-16T14:55:09.558 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:09.559 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-16 14:49:52.514186341 +0000 2024-09-16T14:55:09.559 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-16 14:49:52.262180024 +0000 2024-09-16T14:55:09.559 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-16 14:49:52.262180024 +0000 2024-09-16T14:55:09.559 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-16T14:55:09.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T14:55:09.612 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-16T14:55:09.612 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-16T14:55:09.612 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000376074 s, 1.4 MB/s 2024-09-16T14:55:09.613 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T14:55:09.664 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-16T14:55:09.709 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-16 14:49:53.018198975 +0000 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-16 14:49:52.762192558 +0000 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-16 14:49:52.762192558 +0000 2024-09-16T14:55:09.710 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-16T14:55:09.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T14:55:09.764 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-16T14:55:09.764 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-16T14:55:09.764 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000385037 s, 1.3 MB/s 2024-09-16T14:55:09.765 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T14:55:09.819 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:09.819 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:09.819 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T14:55:09.825 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T14:55:09.825 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-16T14:55:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T14:55:09.874 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:09.874 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-16T14:55:09.875 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:09.875 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-16 14:49:51.597162103 +0000 2024-09-16T14:55:09.875 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-16 14:49:51.345164354 +0000 2024-09-16T14:55:09.875 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-16 14:49:51.345164354 +0000 2024-09-16T14:55:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-09-16T14:55:09.875 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T14:55:09.932 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-16T14:55:09.932 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-16T14:55:09.933 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000383071 s, 1.3 MB/s 2024-09-16T14:55:09.934 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T14:55:09.983 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-16 14:49:52.081157780 +0000 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-16 14:49:51.813160173 +0000 2024-09-16T14:55:10.031 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-16 14:49:51.813160173 +0000 2024-09-16T14:55:10.032 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-09-16T14:55:10.032 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T14:55:10.084 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-16T14:55:10.084 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-16T14:55:10.085 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00042732 s, 1.2 MB/s 2024-09-16T14:55:10.086 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T14:55:10.135 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-16 14:49:52.601153135 +0000 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-16 14:49:52.321155636 +0000 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-16 14:49:52.321155636 +0000 2024-09-16T14:55:10.182 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-09-16T14:55:10.183 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T14:55:10.236 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-16T14:55:10.236 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-16T14:55:10.236 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000320415 s, 1.6 MB/s 2024-09-16T14:55:10.237 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T14:55:10.287 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 941 Links: 1 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-16 14:49:53.077148884 +0000 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-16 14:49:52.829151099 +0000 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-16 14:49:52.829151099 +0000 2024-09-16T14:55:10.334 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2024-09-16T14:55:10.334 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T14:55:10.389 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-16T14:55:10.389 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-16T14:55:10.389 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000416927 s, 1.2 MB/s 2024-09-16T14:55:10.390 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T14:55:10.439 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:10.439 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-16T14:55:10.439 INFO:tasks.ceph:Generating config... 2024-09-16T14:55:10.440 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-16T14:55:10.440 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-16T14:55:10.440 INFO:tasks.ceph:[global] ms type = async 2024-09-16T14:55:10.440 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T14:55:10.441 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T14:55:10.441 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T14:55:10.441 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T14:55:10.441 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T14:55:10.441 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T14:55:10.441 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-16T14:55:10.442 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-16T14:55:10.443 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T14:55:10.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T14:55:10.477 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T14:55:10.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T14:55:10.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T14:55:10.628 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.79:6789]')] 2024-09-16T14:55:10.629 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.79:6789]', 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2024-09-16T14:55:10.629 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:10.630 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T14:55:10.674 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.79:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid 9ad57213-02ce-4767-b3ba-f402828e922a 2024-09-16T14:55:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = pacific 2024-09-16T14:55:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 9ad57213-02ce-4767-b3ba-f402828e922a 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2024-09-16T14:55:10.751315+0000 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-16T14:55:10.751315+0000 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 16 (pacific) 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 3 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:0: v1:172.21.15.79:6789/0 mon.a 2024-09-16T14:55:10.751 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T14:55:10.752 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T14:55:10.798 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9ad57213-02ce-4767-b3ba-f402828e922a... 2024-09-16T14:55:10.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T14:55:10.843 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T14:55:10.872 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-09-16T14:55:10.872 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-09-16T14:55:10.872 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T14:55:10.872 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.873 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-09-16T14:55:10.874 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.875 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = [v1:172.21.15.79:6789] 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: mon election default strategy = 3 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: ms bind msgr2 = False 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: ms type = async 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 9ad57213-02ce-4767-b3ba-f402828e922a 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.876 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-09-16T14:55:10.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-09-16T14:55:10.878 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore zero block detection = True 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 20 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 20 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 10 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T14:55:10.879 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify cached snaps = True 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify missing on start = True 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock override recovery settings = True 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd memory target = 1610612736 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd op queue = debug_random 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: osd op queue cut off = debug_random 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-16T14:55:10.880 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-09-16T14:55:10.881 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T14:55:10.882 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: mon scrub interval = 300 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-09-16T14:55:10.883 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T14:55:10.884 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T14:55:10.884 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-09-16T14:55:10.885 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-16T14:55:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-09-16T14:55:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T14:55:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-09-16T14:55:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T14:55:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = [v1:172.21.15.79:6789] 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: mon election default strategy = 3 2024-09-16T14:55:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: ms bind msgr2 = False 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: ms type = async 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 9ad57213-02ce-4767-b3ba-f402828e922a 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-09-16T14:55:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore zero block detection = True 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-09-16T14:55:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify cached snaps = True 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify missing on start = True 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock override recovery settings = True 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd memory target = 1610612736 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-09-16T14:55:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: osd op queue = debug_random 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: osd op queue cut off = debug_random 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.893 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-09-16T14:55:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: mon scrub interval = 300 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T14:55:10.896 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-09-16T14:55:10.896 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T14:55:10.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T14:55:10.978 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T14:55:10.978 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:10.979 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T14:55:10.983 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:10.984 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T14:55:11.029 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T14:55:11.029 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:11.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T14:55:11.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T14:55:11.094 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:11.094 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:11.142 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T14:55:11.142 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:11.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T14:55:11.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T14:55:11.164 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:11.164 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:11.210 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T14:55:11.210 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T14:55:11.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T14:55:11.253 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T14:55:11.256 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T14:55:11.256 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T14:55:11.256 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T14:55:11.290 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T14:55:11.308 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T14:55:11.309 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-16T14:55:11.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T14:55:11.322 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:11.322 INFO:tasks.ceph:role: osd.0 2024-09-16T14:55:11.322 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T14:55:11.322 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T14:55:11.384 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:55:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:55:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:55:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T14:55:11.384 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:55:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:55:11.385 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:55:11.385 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:55:11.385 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:55:11.385 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:55:11.839 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-16T14:55:11.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-16T14:55:11.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T14:55:11.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T14:55:11.942 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:55:11.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:55:11.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T14:55:11.995 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:11.995 INFO:tasks.ceph:role: osd.1 2024-09-16T14:55:11.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T14:55:11.995 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T14:55:12.057 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:55:12.058 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:55:12.059 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:55:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-16T14:55:12.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-16T14:55:12.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T14:55:12.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T14:55:12.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:55:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:55:12.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T14:55:12.746 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:12.746 INFO:tasks.ceph:role: osd.2 2024-09-16T14:55:12.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T14:55:12.746 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:55:12.810 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:55:13.294 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-16T14:55:13.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-16T14:55:13.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T14:55:13.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T14:55:13.439 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:55:13.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:55:13.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:13.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:13.540+0000 7f6df3ce07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T14:55:13.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:13.544+0000 7f6df3ce07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T14:55:13.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:13.544+0000 7f6df3ce07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T14:55:13.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:13.544+0000 7f6df3ce07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T14:55:13.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:13.544+0000 7f6df3ce07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T14:55:13.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:13.544+0000 7f6df3ce07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T14:55:16.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T14:55:16.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:16.632+0000 7f8b13d6b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T14:55:16.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:16.632+0000 7f8b13d6b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T14:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:16.632+0000 7f8b13d6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T14:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:16.632+0000 7f8b13d6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T14:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:16.632+0000 7f8b13d6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T14:55:16.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:16.632+0000 7f8b13d6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T14:55:19.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T14:55:19.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:19.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:19.744+0000 7f72741317c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T14:55:19.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:19.744+0000 7f72741317c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T14:55:19.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:19.744+0000 7f72741317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T14:55:19.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:19.744+0000 7f72741317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T14:55:19.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:19.744+0000 7f72741317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T14:55:19.749 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-16T14:55:19.748+0000 7f72741317c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T14:55:22.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T14:55:22.790 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T14:55:22.804 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:22.805 INFO:tasks.ceph:role: osd.3 2024-09-16T14:55:22.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T14:55:22.805 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:55:22.866 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:55:23.349 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-16T14:55:23.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-16T14:55:23.352 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-16T14:55:23.508 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T14:55:23.519 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:55:23.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:55:23.520 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T14:55:23.577 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:23.577 INFO:tasks.ceph:role: osd.4 2024-09-16T14:55:23.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T14:55:23.577 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T14:55:23.641 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:55:23.641 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:55:23.641 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:55:23.641 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T14:55:23.641 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:55:23.642 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:55:23.642 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:55:23.642 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:55:23.642 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:55:23.642 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:55:24.088 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-16T14:55:24.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-16T14:55:24.091 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-16T14:55:24.174 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T14:55:24.225 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:55:24.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:55:24.226 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T14:55:24.279 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-16T14:55:24.280 INFO:tasks.ceph:role: osd.5 2024-09-16T14:55:24.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T14:55:24.280 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T14:55:24.340 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:55:24.340 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:55:24.341 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:55:24.808 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-16T14:55:24.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-16T14:55:24.862 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-16T14:55:25.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T14:55:25.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:55:25.018 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:55:25.018 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:25.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:25.136+0000 7f148da3f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T14:55:25.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:25.140+0000 7f148da3f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T14:55:25.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:25.140+0000 7f148da3f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T14:55:25.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:25.140+0000 7f148da3f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T14:55:25.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:25.140+0000 7f148da3f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T14:55:25.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:25.148+0000 7f148da3f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T14:55:28.113 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T14:55:28.127 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:28.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:28.204+0000 7fcc1497d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T14:55:28.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:28.204+0000 7fcc1497d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T14:55:28.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:28.204+0000 7fcc1497d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-16T14:55:28.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:28.204+0000 7fcc1497d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-16T14:55:28.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:28.204+0000 7fcc1497d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-16T14:55:28.207 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:28.204+0000 7fcc1497d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T14:55:31.186 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T14:55:31.241 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:31.322 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:31.320+0000 7f7a721a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T14:55:31.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:31.320+0000 7f7a721a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T14:55:31.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:31.320+0000 7f7a721a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-16T14:55:31.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:31.320+0000 7f7a721a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-16T14:55:31.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:31.320+0000 7f7a721a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-16T14:55:31.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-16T14:55:31.320+0000 7f7a721a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T14:55:34.284 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T14:55:34.338 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T14:55:34.338 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:34.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T14:55:34.353 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:34.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T14:55:34.409 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:34.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T14:55:34.465 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:34.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T14:55:34.521 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:34.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T14:55:34.535 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:34.535 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T14:55:34.589 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:34.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T14:55:34.645 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:34.645 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T14:55:34.694 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T14:55:34.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T14:55:34.705 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2024-09-16T14:55:34.705 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDPRuhmUD0oDxAAhLwYLgzEfFJ8MBSw8PSKpg== 2024-09-16T14:55:34.705 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDRRuhmTPeOIBAA/kRmMJJlidPdTLaKr+PuWg== 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDURuhmcTHbJRAASx6nb97Ja4pkGXd+Z8H6QQ== 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDXRuhmSParLBAAVb/PY69wSeqeBo7J60c8zA== 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDdRuhm8pRiCBAARuv8fdnpVtxN/ecwj32lxA== 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDgRuhmse9bDBAAaX1RaJhXDqpL0DyByU8bQA== 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2024-09-16T14:55:34.706 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDjRuhmUhNFExAAbVSTUGQSzEFxBYdO13KIrw== 2024-09-16T14:55:34.707 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-09-16T14:55:34.707 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDPRuhmChRgERAARdhJTr9lpC04KYClk1+d5A== 2024-09-16T14:55:34.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T14:55:34.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:55:34.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:55:34.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:55:35.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:55:35.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:55:35.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:55:35.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T14:55:35.379 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T14:55:35.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T14:55:35.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T14:55:35.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T14:55:35.530 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:55:35.578 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T14:55:35.578 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T14:55:35.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T14:55:35.622 INFO:tasks.ceph.mon.a:Started 2024-09-16T14:55:35.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph config set mgr mgr_pool false --force 2024-09-16T14:55:35.864 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T14:55:35.864 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T14:55:35.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T14:55:35.867 INFO:tasks.ceph.mgr.x:Started 2024-09-16T14:55:35.867 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T14:55:35.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T14:55:36.042 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-09-16T14:55:36.058 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T14:55:36.058 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T14:55:36.058 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:36.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T14:55:36.067 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:36.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T14:55:36.117 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-16T14:55:36.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T14:55:36.122 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:36.120+0000 7fa7322f7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T14:55:36.131 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:36.131 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T14:55:36.144 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:36.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T14:55:36.201 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-16T14:55:36.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T14:55:36.257 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 64cb5343-f41e-43ff-9cee-a9356579c0cc 0 2024-09-16T14:55:36.509 INFO:teuthology.orchestra.run.smithi116.stdout:0 2024-09-16T14:55:36.527 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new d0b0e774-5d6d-408f-a324-4bd14d56a1e4 1 2024-09-16T14:55:36.622 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:36.616+0000 7fa7322f7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T14:55:36.730 INFO:teuthology.orchestra.run.smithi116.stdout:1 2024-09-16T14:55:36.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new f2e06962-b2f6-4d7a-bed0-a97f3e826f12 2 2024-09-16T14:55:36.831 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:36.828+0000 7fa7322f7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T14:55:36.955 INFO:teuthology.orchestra.run.smithi116.stdout:2 2024-09-16T14:55:36.972 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new e03f2627-38a0-4d8b-a152-cc5e016cfe1b 3 2024-09-16T14:55:37.180 INFO:teuthology.orchestra.run.smithi116.stdout:3 2024-09-16T14:55:37.197 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new abd75d6d-8bfa-4557-ac6b-fe094f742786 4 2024-09-16T14:55:37.370 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.368+0000 7fa7322f7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T14:55:37.396 INFO:teuthology.orchestra.run.smithi116.stdout:4 2024-09-16T14:55:37.413 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new b8325629-8a43-4e9b-b43c-c26a274c1305 5 2024-09-16T14:55:37.424 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.420+0000 7fa7322f7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T14:55:37.475 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.472+0000 7fa7322f7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T14:55:37.552 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.548+0000 7fa7322f7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T14:55:37.603 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.600+0000 7fa7322f7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T14:55:37.622 INFO:teuthology.orchestra.run.smithi116.stdout:5 2024-09-16T14:55:37.639 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T14:55:37.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T14:55:37.642 INFO:tasks.ceph.osd.0:Started 2024-09-16T14:55:37.642 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T14:55:37.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T14:55:37.644 INFO:tasks.ceph.osd.1:Started 2024-09-16T14:55:37.644 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T14:55:37.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T14:55:37.647 INFO:tasks.ceph.osd.2:Started 2024-09-16T14:55:37.647 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T14:55:37.647 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T14:55:37.649 INFO:tasks.ceph.osd.3:Started 2024-09-16T14:55:37.649 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T14:55:37.649 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T14:55:37.651 INFO:tasks.ceph.osd.4:Started 2024-09-16T14:55:37.651 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T14:55:37.652 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T14:55:37.654 INFO:tasks.ceph.osd.5:Started 2024-09-16T14:55:37.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:55:37.685 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.680+0000 7fa7322f7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T14:55:37.742 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.740+0000 7fa7322f7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T14:55:37.837 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:37.838 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":8,"fsid":"9ad57213-02ce-4767-b3ba-f402828e922a","created":"2024-09-16T14:55:35.753903+0000","modified":"2024-09-16T14:55:37.619170+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T14:55:37.619170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64cb5343-f41e-43ff-9cee-a9356579c0cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0b0e774-5d6d-408f-a324-4bd14d56a1e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2e06962-b2f6-4d7a-bed0-a97f3e826f12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e03f2627-38a0-4d8b-a152-cc5e016cfe1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"abd75d6d-8bfa-4557-ac6b-fe094f742786","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b8325629-8a43-4e9b-b43c-c26a274c1305","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:55:37.852 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T14:55:37.853 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T14:55:37.897 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.896+0000 7fa7322f7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T14:55:37.956 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:37.952+0000 7fa7322f7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T14:55:38.022 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-16T14:55:38.020+0000 7f598c6627c0 -1 Falling back to public interface 2024-09-16T14:55:38.242 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-09-16T14:55:38.240+0000 7f360ebfe7c0 -1 Falling back to public interface 2024-09-16T14:55:38.243 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-16T14:55:38.240+0000 7f592bcf97c0 -1 Falling back to public interface 2024-09-16T14:55:38.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:55:38.244+0000 7f54383317c0 -1 Falling back to public interface 2024-09-16T14:55:38.250 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-09-16T14:55:38.248+0000 7f913ad927c0 -1 Falling back to public interface 2024-09-16T14:55:38.254 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-16T14:55:38.252+0000 7fa2262d37c0 -1 Falling back to public interface 2024-09-16T14:55:38.457 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T14:55:38.592 INFO:tasks.ceph.mgr.x.smithi079.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-16T14:55:38.592 INFO:tasks.ceph.mgr.x.smithi079.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-16T14:55:38.592 INFO:tasks.ceph.mgr.x.smithi079.stderr: from numpy import show_config as show_numpy_config 2024-09-16T14:55:38.628 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:38.624+0000 7fa7322f7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T14:55:38.638 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-16T14:55:38.638 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":8,"fsid":"9ad57213-02ce-4767-b3ba-f402828e922a","created":"2024-09-16T14:55:35.753903+0000","modified":"2024-09-16T14:55:37.619170+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T14:55:37.619170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64cb5343-f41e-43ff-9cee-a9356579c0cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d0b0e774-5d6d-408f-a324-4bd14d56a1e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f2e06962-b2f6-4d7a-bed0-a97f3e826f12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e03f2627-38a0-4d8b-a152-cc5e016cfe1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"abd75d6d-8bfa-4557-ac6b-fe094f742786","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b8325629-8a43-4e9b-b43c-c26a274c1305","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:55:38.654 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-16T14:55:38.779 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:38.776+0000 7fa7322f7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T14:55:38.979 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:38.976+0000 7fa7322f7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T14:55:39.049 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:39.044+0000 7fa7322f7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T14:55:39.190 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:39.188+0000 7fa7322f7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T14:55:39.835 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:39.832+0000 7fa7322f7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T14:55:39.910 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:39.908+0000 7fa7322f7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T14:55:40.089 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:40.084+0000 7fa7322f7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T14:55:40.162 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:40.160+0000 7fa7322f7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T14:55:40.448 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:40.444+0000 7fa7322f7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T14:55:40.512 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:40.508+0000 7fa7322f7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T14:55:41.542 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-09-16T14:55:41.540+0000 7fa6d98aa640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T14:55:41.651 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-16T14:55:41.648+0000 7f598c6627c0 -1 osd.2 0 log_to_monitors true 2024-09-16T14:55:41.962 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-09-16T14:55:41.960+0000 7f913ad927c0 -1 osd.4 0 log_to_monitors true 2024-09-16T14:55:42.051 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-09-16T14:55:42.048+0000 7f360ebfe7c0 -1 osd.5 0 log_to_monitors true 2024-09-16T14:55:42.054 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-16T14:55:42.052+0000 7f592bcf97c0 -1 osd.3 0 log_to_monitors true 2024-09-16T14:55:42.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:55:42.064+0000 7f54383317c0 -1 osd.1 0 log_to_monitors true 2024-09-16T14:55:42.178 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-16T14:55:42.176+0000 7fa2262d37c0 -1 osd.0 0 log_to_monitors true 2024-09-16T14:55:43.560 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-16T14:55:43.556+0000 7f5987de4640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T14:55:43.560 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-09-16T14:55:43.556+0000 7f9136514640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T14:55:43.561 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-16T14:55:43.560+0000 7f592747b640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T14:55:43.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:55:43.560+0000 7f5433ab3640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T14:55:43.566 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-16T14:55:43.564+0000 7f5984431640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:55:43.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:55:43.568+0000 7f5430100640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:55:43.576 INFO:tasks.ceph.osd.4.smithi116.stderr:2024-09-16T14:55:43.572+0000 7f9132b61640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:55:43.577 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-09-16T14:55:43.572+0000 7f5923ac8640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:55:44.371 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-09-16T14:55:44.368+0000 7f360a380640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T14:55:44.376 INFO:tasks.ceph.osd.5.smithi116.stderr:2024-09-16T14:55:44.372+0000 7f36029c5640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:55:44.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-16T14:55:44.484+0000 7fa221a55640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T14:55:44.490 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-16T14:55:44.488+0000 7fa21a09a640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:55:45.260 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T14:55:45.550 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-16T14:55:45.550 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":11,"fsid":"9ad57213-02ce-4767-b3ba-f402828e922a","created":"2024-09-16T14:55:35.753903+0000","modified":"2024-09-16T14:55:44.548974+0000","last_up_change":"2024-09-16T14:55:44.548974+0000","last_in_change":"2024-09-16T14:55:37.619170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"64cb5343-f41e-43ff-9cee-a9356579c0cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6808","nonce":934526015}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6809","nonce":934526015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6811","nonce":934526015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6810","nonce":934526015}]},"public_addr":"172.21.15.79:6808/934526015","cluster_addr":"172.21.15.79:6809/934526015","heartbeat_back_addr":"172.21.15.79:6811/934526015","heartbeat_front_addr":"172.21.15.79:6810/934526015","state":["exists","up"]},{"osd":1,"uuid":"d0b0e774-5d6d-408f-a324-4bd14d56a1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6804","nonce":3624226452}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6805","nonce":3624226452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6807","nonce":3624226452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6806","nonce":3624226452}]},"public_addr":"172.21.15.79:6804/3624226452","cluster_addr":"172.21.15.79:6805/3624226452","heartbeat_back_addr":"172.21.15.79:6807/3624226452","heartbeat_front_addr":"172.21.15.79:6806/3624226452","state":["exists","up"]},{"osd":2,"uuid":"f2e06962-b2f6-4d7a-bed0-a97f3e826f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6800","nonce":14125057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6801","nonce":14125057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6803","nonce":14125057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6802","nonce":14125057}]},"public_addr":"172.21.15.79:6800/14125057","cluster_addr":"172.21.15.79:6801/14125057","heartbeat_back_addr":"172.21.15.79:6803/14125057","heartbeat_front_addr":"172.21.15.79:6802/14125057","state":["exists","up"]},{"osd":3,"uuid":"e03f2627-38a0-4d8b-a152-cc5e016cfe1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6804","nonce":3934315852}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6805","nonce":3934315852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6807","nonce":3934315852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6806","nonce":3934315852}]},"public_addr":"172.21.15.116:6804/3934315852","cluster_addr":"172.21.15.116:6805/3934315852","heartbeat_back_addr":"172.21.15.116:6807/3934315852","heartbeat_front_addr":"172.21.15.116:6806/3934315852","state":["exists","up"]},{"osd":4,"uuid":"abd75d6d-8bfa-4557-ac6b-fe094f742786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6808","nonce":1855349945}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6809","nonce":1855349945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6811","nonce":1855349945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6810","nonce":1855349945}]},"public_addr":"172.21.15.116:6808/1855349945","cluster_addr":"172.21.15.116:6809/1855349945","heartbeat_back_addr":"172.21.15.116:6811/1855349945","heartbeat_front_addr":"172.21.15.116:6810/1855349945","state":["exists","up"]},{"osd":5,"uuid":"b8325629-8a43-4e9b-b43c-c26a274c1305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6800","nonce":2171612314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6801","nonce":2171612314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6803","nonce":2171612314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6802","nonce":2171612314}]},"public_addr":"172.21.15.116:6800/2171612314","cluster_addr":"172.21.15.116:6801/2171612314","heartbeat_back_addr":"172.21.15.116:6803/2171612314","heartbeat_front_addr":"172.21.15.116:6802/2171612314","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:55:45.568 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-16T14:55:45.569 INFO:tasks.ceph:Creating RBD pool 2024-09-16T14:55:45.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T14:55:46.581 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2024-09-16T14:55:46.605 DEBUG:teuthology.orchestra.run.smithi079:> rbd --cluster ceph pool init rbd 2024-09-16T14:55:49.612 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T14:55:49.613 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T14:55:49.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T14:55:49.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T14:55:49.614 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T14:55:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:49.976 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6812","nonce":3211754599}]},"active_addr":"172.21.15.79:6812/3211754599","active_change":"2024-09-16T14:55:40.531177+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1732386567}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1519307592}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3200438441}]}]} 2024-09-16T14:55:49.978 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T14:55:49.978 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T14:55:49.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:55:50.245 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:50.245 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"fsid":"9ad57213-02ce-4767-b3ba-f402828e922a","created":"2024-09-16T14:55:35.753903+0000","modified":"2024-09-16T14:55:49.590394+0000","last_up_change":"2024-09-16T14:55:44.548974+0000","last_in_change":"2024-09-16T14:55:37.619170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-16T14:55:45.899858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64cb5343-f41e-43ff-9cee-a9356579c0cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6808","nonce":934526015}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6809","nonce":934526015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6811","nonce":934526015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6810","nonce":934526015}]},"public_addr":"172.21.15.79:6808/934526015","cluster_addr":"172.21.15.79:6809/934526015","heartbeat_back_addr":"172.21.15.79:6811/934526015","heartbeat_front_addr":"172.21.15.79:6810/934526015","state":["exists","up"]},{"osd":1,"uuid":"d0b0e774-5d6d-408f-a324-4bd14d56a1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6804","nonce":3624226452}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6805","nonce":3624226452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6807","nonce":3624226452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6806","nonce":3624226452}]},"public_addr":"172.21.15.79:6804/3624226452","cluster_addr":"172.21.15.79:6805/3624226452","heartbeat_back_addr":"172.21.15.79:6807/3624226452","heartbeat_front_addr":"172.21.15.79:6806/3624226452","state":["exists","up"]},{"osd":2,"uuid":"f2e06962-b2f6-4d7a-bed0-a97f3e826f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6800","nonce":14125057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6801","nonce":14125057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6803","nonce":14125057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6802","nonce":14125057}]},"public_addr":"172.21.15.79:6800/14125057","cluster_addr":"172.21.15.79:6801/14125057","heartbeat_back_addr":"172.21.15.79:6803/14125057","heartbeat_front_addr":"172.21.15.79:6802/14125057","state":["exists","up"]},{"osd":3,"uuid":"e03f2627-38a0-4d8b-a152-cc5e016cfe1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6804","nonce":3934315852}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6805","nonce":3934315852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6807","nonce":3934315852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6806","nonce":3934315852}]},"public_addr":"172.21.15.116:6804/3934315852","cluster_addr":"172.21.15.116:6805/3934315852","heartbeat_back_addr":"172.21.15.116:6807/3934315852","heartbeat_front_addr":"172.21.15.116:6806/3934315852","state":["exists","up"]},{"osd":4,"uuid":"abd75d6d-8bfa-4557-ac6b-fe094f742786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6808","nonce":1855349945}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6809","nonce":1855349945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6811","nonce":1855349945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6810","nonce":1855349945}]},"public_addr":"172.21.15.116:6808/1855349945","cluster_addr":"172.21.15.116:6809/1855349945","heartbeat_back_addr":"172.21.15.116:6811/1855349945","heartbeat_front_addr":"172.21.15.116:6810/1855349945","state":["exists","up"]},{"osd":5,"uuid":"b8325629-8a43-4e9b-b43c-c26a274c1305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6800","nonce":2171612314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6801","nonce":2171612314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6803","nonce":2171612314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6802","nonce":2171612314}]},"public_addr":"172.21.15.116:6800/2171612314","cluster_addr":"172.21.15.116:6801/2171612314","heartbeat_back_addr":"172.21.15.116:6803/2171612314","heartbeat_front_addr":"172.21.15.116:6802/2171612314","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.157553+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.025771+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:42.691382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.011870+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:42.995746+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.012939+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:55:50.261 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T14:55:50.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:55:50.522 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:50.522 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"fsid":"9ad57213-02ce-4767-b3ba-f402828e922a","created":"2024-09-16T14:55:35.753903+0000","modified":"2024-09-16T14:55:49.590394+0000","last_up_change":"2024-09-16T14:55:44.548974+0000","last_in_change":"2024-09-16T14:55:37.619170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-16T14:55:45.899858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64cb5343-f41e-43ff-9cee-a9356579c0cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6808","nonce":934526015}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6809","nonce":934526015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6811","nonce":934526015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6810","nonce":934526015}]},"public_addr":"172.21.15.79:6808/934526015","cluster_addr":"172.21.15.79:6809/934526015","heartbeat_back_addr":"172.21.15.79:6811/934526015","heartbeat_front_addr":"172.21.15.79:6810/934526015","state":["exists","up"]},{"osd":1,"uuid":"d0b0e774-5d6d-408f-a324-4bd14d56a1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6804","nonce":3624226452}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6805","nonce":3624226452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6807","nonce":3624226452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6806","nonce":3624226452}]},"public_addr":"172.21.15.79:6804/3624226452","cluster_addr":"172.21.15.79:6805/3624226452","heartbeat_back_addr":"172.21.15.79:6807/3624226452","heartbeat_front_addr":"172.21.15.79:6806/3624226452","state":["exists","up"]},{"osd":2,"uuid":"f2e06962-b2f6-4d7a-bed0-a97f3e826f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6800","nonce":14125057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6801","nonce":14125057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6803","nonce":14125057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6802","nonce":14125057}]},"public_addr":"172.21.15.79:6800/14125057","cluster_addr":"172.21.15.79:6801/14125057","heartbeat_back_addr":"172.21.15.79:6803/14125057","heartbeat_front_addr":"172.21.15.79:6802/14125057","state":["exists","up"]},{"osd":3,"uuid":"e03f2627-38a0-4d8b-a152-cc5e016cfe1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6804","nonce":3934315852}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6805","nonce":3934315852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6807","nonce":3934315852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6806","nonce":3934315852}]},"public_addr":"172.21.15.116:6804/3934315852","cluster_addr":"172.21.15.116:6805/3934315852","heartbeat_back_addr":"172.21.15.116:6807/3934315852","heartbeat_front_addr":"172.21.15.116:6806/3934315852","state":["exists","up"]},{"osd":4,"uuid":"abd75d6d-8bfa-4557-ac6b-fe094f742786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6808","nonce":1855349945}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6809","nonce":1855349945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6811","nonce":1855349945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6810","nonce":1855349945}]},"public_addr":"172.21.15.116:6808/1855349945","cluster_addr":"172.21.15.116:6809/1855349945","heartbeat_back_addr":"172.21.15.116:6811/1855349945","heartbeat_front_addr":"172.21.15.116:6810/1855349945","state":["exists","up"]},{"osd":5,"uuid":"b8325629-8a43-4e9b-b43c-c26a274c1305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6800","nonce":2171612314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6801","nonce":2171612314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6803","nonce":2171612314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6802","nonce":2171612314}]},"public_addr":"172.21.15.116:6800/2171612314","cluster_addr":"172.21.15.116:6801/2171612314","heartbeat_back_addr":"172.21.15.116:6803/2171612314","heartbeat_front_addr":"172.21.15.116:6802/2171612314","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.157553+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.025771+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:42.691382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.011870+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:42.995746+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.012939+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:55:50.538 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T14:55:50.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T14:55:50.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T14:55:50.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T14:55:50.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T14:55:50.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T14:55:50.699 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:50.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T14:55:50.701 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:50.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T14:55:50.760 INFO:teuthology.orchestra.run.smithi079.stdout:47244640260 2024-09-16T14:55:50.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T14:55:50.763 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:50.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T14:55:50.770 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:50.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T14:55:50.771 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:50.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T14:55:51.126 INFO:teuthology.orchestra.run.smithi079.stdout:47244640257 2024-09-16T14:55:51.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640257 for osd.4 2024-09-16T14:55:51.144 INFO:teuthology.orchestra.run.smithi079.stdout:47244640258 2024-09-16T14:55:51.154 INFO:teuthology.orchestra.run.smithi079.stdout:47244640257 2024-09-16T14:55:51.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2024-09-16T14:55:51.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640257 for osd.2 2024-09-16T14:55:51.180 INFO:teuthology.orchestra.run.smithi079.stdout:47244640257 2024-09-16T14:55:51.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640257 for osd.1 2024-09-16T14:55:51.209 INFO:teuthology.orchestra.run.smithi079.stdout:47244640258 2024-09-16T14:55:51.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.3 2024-09-16T14:55:51.225 INFO:teuthology.orchestra.run.smithi079.stdout:47244640258 2024-09-16T14:55:51.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2024-09-16T14:55:52.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T14:55:52.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T14:55:52.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T14:55:52.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T14:55:52.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T14:55:52.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T14:55:52.499 INFO:teuthology.orchestra.run.smithi079.stdout:47244640257 2024-09-16T14:55:52.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640257 for osd.2 2024-09-16T14:55:52.528 INFO:teuthology.orchestra.run.smithi079.stdout:47244640258 2024-09-16T14:55:52.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2024-09-16T14:55:52.593 INFO:teuthology.orchestra.run.smithi079.stdout:47244640257 2024-09-16T14:55:52.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640257 for osd.4 2024-09-16T14:55:52.665 INFO:teuthology.orchestra.run.smithi079.stdout:47244640260 2024-09-16T14:55:52.667 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:52.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2024-09-16T14:55:52.689 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:52.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2024-09-16T14:55:52.690 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:52.705 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:52.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2024-09-16T14:55:52.721 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:53.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T14:55:53.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T14:55:53.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T14:55:53.839 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:53.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2024-09-16T14:55:53.857 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:53.871 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:53.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2024-09-16T14:55:53.888 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:53.940 INFO:teuthology.orchestra.run.smithi079.stdout:47244640259 2024-09-16T14:55:53.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2024-09-16T14:55:53.957 DEBUG:teuthology.parallel:result is None 2024-09-16T14:55:53.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T14:55:53.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:55:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:54.223 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T14:55:54.238 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-16T14:55:52.536746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162948,"kb_used_data":800,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068092,"statfs":{"total":579820584960,"available":579653726208,"internally_reserved":0,"allocated":819200,"data_stored":225446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":165927591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.088682+0000","last_change":"2024-09-16T14:55:50.089122+0000","last_active":"2024-09-16T14:55:50.088682+0000","last_peered":"2024-09-16T14:55:50.088682+0000","last_clean":"2024-09-16T14:55:50.088682+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T14:55:50.088682+0000","last_undegraded":"2024-09-16T14:55:50.088682+0000","last_fullsized":"2024-09-16T14:55:50.088682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.040167+0000","last_change":"2024-09-16T14:55:50.040167+0000","last_active":"2024-09-16T14:55:50.040167+0000","last_peered":"2024-09-16T14:55:50.040167+0000","last_clean":"2024-09-16T14:55:50.040167+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T14:55:50.040167+0000","last_undegraded":"2024-09-16T14:55:50.040167+0000","last_fullsized":"2024-09-16T14:55:50.040167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.603629+0000","last_change":"2024-09-16T14:55:49.603629+0000","last_active":"2024-09-16T14:55:49.603629+0000","last_peered":"2024-09-16T14:55:49.603629+0000","last_clean":"2024-09-16T14:55:49.603629+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T14:55:49.603629+0000","last_undegraded":"2024-09-16T14:55:49.603629+0000","last_fullsized":"2024-09-16T14:55:49.603629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.600852+0000","last_change":"2024-09-16T14:55:49.600852+0000","last_active":"2024-09-16T14:55:49.600852+0000","last_peered":"2024-09-16T14:55:49.600852+0000","last_clean":"2024-09-16T14:55:49.600852+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T14:55:49.600852+0000","last_undegraded":"2024-09-16T14:55:49.600852+0000","last_fullsized":"2024-09-16T14:55:49.600852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"14'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.601026+0000","last_change":"2024-09-16T14:55:49.601026+0000","last_active":"2024-09-16T14:55:49.601026+0000","last_peered":"2024-09-16T14:55:49.601026+0000","last_clean":"2024-09-16T14:55:49.601026+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T14:55:49.601026+0000","last_undegraded":"2024-09-16T14:55:49.601026+0000","last_fullsized":"2024-09-16T14:55:49.601026+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"16'2","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.607015+0000","last_change":"2024-09-16T14:55:49.604671+0000","last_active":"2024-09-16T14:55:49.607015+0000","last_peered":"2024-09-16T14:55:49.607015+0000","last_clean":"2024-09-16T14:55:49.607015+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T14:55:49.607015+0000","last_undegraded":"2024-09-16T14:55:49.607015+0000","last_fullsized":"2024-09-16T14:55:49.607015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.088611+0000","last_change":"2024-09-16T14:55:50.089023+0000","last_active":"2024-09-16T14:55:50.088611+0000","last_peered":"2024-09-16T14:55:50.088611+0000","last_clean":"2024-09-16T14:55:50.088611+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T14:55:50.088611+0000","last_undegraded":"2024-09-16T14:55:50.088611+0000","last_fullsized":"2024-09-16T14:55:50.088611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.040247+0000","last_change":"2024-09-16T14:55:50.040247+0000","last_active":"2024-09-16T14:55:50.040247+0000","last_peered":"2024-09-16T14:55:50.040247+0000","last_clean":"2024-09-16T14:55:50.040247+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T14:55:50.040247+0000","last_undegraded":"2024-09-16T14:55:50.040247+0000","last_fullsized":"2024-09-16T14:55:50.040247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":39444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":32025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":39425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":39425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":35683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":143360,"data_stored":39444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:55:54.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:55:54.510 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:54.511 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T14:55:54.527 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-16T14:55:52.536746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162948,"kb_used_data":800,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068092,"statfs":{"total":579820584960,"available":579653726208,"internally_reserved":0,"allocated":819200,"data_stored":225446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":165927591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.088682+0000","last_change":"2024-09-16T14:55:50.089122+0000","last_active":"2024-09-16T14:55:50.088682+0000","last_peered":"2024-09-16T14:55:50.088682+0000","last_clean":"2024-09-16T14:55:50.088682+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T14:55:50.088682+0000","last_undegraded":"2024-09-16T14:55:50.088682+0000","last_fullsized":"2024-09-16T14:55:50.088682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.040167+0000","last_change":"2024-09-16T14:55:50.040167+0000","last_active":"2024-09-16T14:55:50.040167+0000","last_peered":"2024-09-16T14:55:50.040167+0000","last_clean":"2024-09-16T14:55:50.040167+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T14:55:50.040167+0000","last_undegraded":"2024-09-16T14:55:50.040167+0000","last_fullsized":"2024-09-16T14:55:50.040167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.603629+0000","last_change":"2024-09-16T14:55:49.603629+0000","last_active":"2024-09-16T14:55:49.603629+0000","last_peered":"2024-09-16T14:55:49.603629+0000","last_clean":"2024-09-16T14:55:49.603629+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T14:55:49.603629+0000","last_undegraded":"2024-09-16T14:55:49.603629+0000","last_fullsized":"2024-09-16T14:55:49.603629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.600852+0000","last_change":"2024-09-16T14:55:49.600852+0000","last_active":"2024-09-16T14:55:49.600852+0000","last_peered":"2024-09-16T14:55:49.600852+0000","last_clean":"2024-09-16T14:55:49.600852+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T14:55:49.600852+0000","last_undegraded":"2024-09-16T14:55:49.600852+0000","last_fullsized":"2024-09-16T14:55:49.600852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"14'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.601026+0000","last_change":"2024-09-16T14:55:49.601026+0000","last_active":"2024-09-16T14:55:49.601026+0000","last_peered":"2024-09-16T14:55:49.601026+0000","last_clean":"2024-09-16T14:55:49.601026+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T14:55:49.601026+0000","last_undegraded":"2024-09-16T14:55:49.601026+0000","last_fullsized":"2024-09-16T14:55:49.601026+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"16'2","reported_seq":17,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:49.607015+0000","last_change":"2024-09-16T14:55:49.604671+0000","last_active":"2024-09-16T14:55:49.607015+0000","last_peered":"2024-09-16T14:55:49.607015+0000","last_clean":"2024-09-16T14:55:49.607015+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T14:55:49.607015+0000","last_undegraded":"2024-09-16T14:55:49.607015+0000","last_fullsized":"2024-09-16T14:55:49.607015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.088611+0000","last_change":"2024-09-16T14:55:50.089023+0000","last_active":"2024-09-16T14:55:50.088611+0000","last_peered":"2024-09-16T14:55:50.088611+0000","last_clean":"2024-09-16T14:55:50.088611+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T14:55:50.088611+0000","last_undegraded":"2024-09-16T14:55:50.088611+0000","last_fullsized":"2024-09-16T14:55:50.088611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-16T14:55:50.040247+0000","last_change":"2024-09-16T14:55:50.040247+0000","last_active":"2024-09-16T14:55:50.040247+0000","last_peered":"2024-09-16T14:55:50.040247+0000","last_clean":"2024-09-16T14:55:50.040247+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T14:55:50.040247+0000","last_undegraded":"2024-09-16T14:55:50.040247+0000","last_fullsized":"2024-09-16T14:55:50.040247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":39444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]}]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":32025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":39425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":39425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":131072,"data_stored":35683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":143360,"data_stored":39444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:55:54.528 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T14:55:54.528 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T14:55:54.528 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T14:55:54.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T14:55:54.821 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T14:55:54.822 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T14:55:54.838 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T14:55:54.838 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-16T14:55:54.848 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-09-16T14:55:54.849 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T14:55:54.849 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T14:55:54.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.33' 2024-09-16T14:55:55.010 INFO:teuthology.orchestra.run.smithi116.stdout:{} 2024-09-16T14:55:55.010 INFO:teuthology.orchestra.run.smithi116.stderr:filestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T14:55:55.026 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33' 2024-09-16T14:55:55.167 INFO:teuthology.orchestra.run.smithi116.stdout:{} 2024-09-16T14:55:55.168 INFO:teuthology.orchestra.run.smithi116.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T14:55:55.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create test 16 16' 2024-09-16T14:55:55.619 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'test' created 2024-09-16T14:55:55.642 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set test size 3' 2024-09-16T14:55:56.718 INFO:teuthology.orchestra.run.smithi116.stderr:set pool 2 size to 3 2024-09-16T14:55:56.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph pg dump pgs --format=json-pretty' 2024-09-16T14:55:57.048 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-16T14:55:57.048 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_ready": true, 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "pg_stats": [ 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.f", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.049 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.050 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.051 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.052 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.053 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.054 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.055 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.e", 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.056 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.057 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.058 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.059 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.060 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.061 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.062 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.063 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.d", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.064 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.065 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.065 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.065 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.065 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.065 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.066 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.067 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.068 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.069 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.070 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.c", 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.071 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.072 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.073 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.074 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.075 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.076 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.077 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.b", 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.078 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.079 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.080 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.081 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.082 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.083 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.084 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.a", 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.085 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.086 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.087 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.088 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.089 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.090 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.091 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.9", 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.092 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.093 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.094 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.095 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.096 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.097 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.098 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.8", 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.099 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.100 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.101 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.102 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.103 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.104 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.105 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.106 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.0", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 14, 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:48.061479+0000", 2024-09-16T14:55:57.107 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:48.061479+0000", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:50.040247+0000", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.108 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.109 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000", 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.000960756, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.110 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.111 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.112 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: 3, 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.113 INFO:teuthology.orchestra.run.smithi116.stdout: 3, 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 3, 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 3, 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.114 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.3", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.115 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.116 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.117 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.118 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.119 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.120 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.121 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.1", 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 15, 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:50.089023+0000", 2024-09-16T14:55:57.122 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:48.060886+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:48.060886+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:50.088611+0000", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.123 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.124 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000", 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.00070656099999999997, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.125 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.126 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.127 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: 5, 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.128 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: 5, 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 5, 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 5, 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.129 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.2", 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.130 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.131 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.132 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.133 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.134 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.135 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.136 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.2", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "16'2", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 17, 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:49.604671+0000", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.137 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:48.060666+0000", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:48.060666+0000", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:49.607015+0000", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.138 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 2, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 2, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.139 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000", 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.0020552309999999998, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 19, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 1, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 2, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.140 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 1, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 2, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 2, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.141 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.142 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: 4, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: 4, 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.143 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 4, 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 4, 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.144 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.1", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.145 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.148 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.149 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.150 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.152 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.3", 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "14'1", 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 15, 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.153 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:47.589955+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:47.589955+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:49.601026+0000", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.154 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 1, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 1, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.155 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000", 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.00074397099999999996, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 1, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.156 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 2, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 1, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.157 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.158 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: 1, 2024-09-16T14:55:57.159 INFO:teuthology.orchestra.run.smithi116.stdout: 5 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: 1, 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: 5 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 1, 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 1, 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.160 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.0", 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.161 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.162 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.163 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.164 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.165 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.166 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.167 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.168 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.7", 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.170 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.171 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.172 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.173 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.174 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.175 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.176 INFO:teuthology.orchestra.run.smithi116.stderr:dumped pgs 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.177 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.4", 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 14, 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.178 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:47.589453+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:47.589453+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:49.600852+0000", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.179 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.180 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000", 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.000610518, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.181 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.182 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.183 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: 1, 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: 3 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.184 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: 1, 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: 3 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 1, 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 1, 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.185 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.6", 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.186 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.188 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.189 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.190 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.191 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.192 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.193 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.194 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.5", 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 15, 2024-09-16T14:55:57.195 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:47.788413+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:47.788413+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.196 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:49.603629+0000", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.197 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.198 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000", 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.00099114899999999998, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.199 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.200 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: 4, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: 2 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: 4, 2024-09-16T14:55:57.202 INFO:teuthology.orchestra.run.smithi116.stdout: 2 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 4, 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 4, 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.203 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.5", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.204 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.205 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.206 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.207 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.208 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.209 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.210 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.6", 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 14, 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.211 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:48.061516+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:48.061516+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:50.040167+0000", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.212 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.213 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000", 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.00088323700000000004, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.214 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.215 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.216 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: 3, 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.217 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: 3, 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: 0 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 3, 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 3, 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.218 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "1.7", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 15, 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 16, 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "active+clean", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:50.089122+0000", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.219 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "2024-09-16T14:55:47.787948+0000", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "2024-09-16T14:55:47.787948+0000", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:50.088682+0000", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 13, 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 13, 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 14, 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.220 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:46.574352+0000", 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.221 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000", 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0.00079356999999999995, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.222 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.223 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.224 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [ 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: 5, 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: 2 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [ 2024-09-16T14:55:57.225 INFO:teuthology.orchestra.run.smithi116.stdout: 5, 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: ], 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": 5, 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": 5, 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [ 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "start": "2", 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: "length": "1" 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.226 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: { 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "pgid": "2.4", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "version": "0'0", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_seq": 0, 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "reported_epoch": 0, 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "state": "unknown", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fresh": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_change": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_active": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_peered": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_active": "0.000000", 2024-09-16T14:55:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: "last_became_peered": "0.000000", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_unstale": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_undegraded": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_fullsized": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "mapping_epoch": 0, 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "log_start": "0'0", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_start": "0'0", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "created": 0, 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_epoch_clean": 0, 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "parent": "0.0", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "parent_split_bits": 0, 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub": "0'0", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.228 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub": "0'0", 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "last_deep_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "last_clean_scrub_stamp": "2024-09-16T14:55:55.609939+0000", 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_scrubbed": 0, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "log_size": 0, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "log_dups_size": 0, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "ondisk_log_size": 0, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "stats_invalid": false, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "dirty_stats_invalid": false, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_stats_invalid": false, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_stats_invalid": false, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "hitset_bytes_stats_invalid": false, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "pin_stats_invalid": false, 2024-09-16T14:55:57.229 INFO:teuthology.orchestra.run.smithi116.stdout: "manifest_stats_invalid": false, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrimq_len": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "last_scrub_duration": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_schedule": "--", 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_duration": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "objects_trimmed": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "snaptrim_duration": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "stat_sum": { 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_clones": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_object_copies": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing_on_primary": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_missing": 0, 2024-09-16T14:55:57.230 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_degraded": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_misplaced": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_unfound": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_dirty": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_whiteouts": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_read_kb": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_write_kb": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_scrub_errors": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_shallow_scrub_errors": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_deep_scrub_errors": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_recovered": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_recovered": 0, 2024-09-16T14:55:57.231 INFO:teuthology.orchestra.run.smithi116.stdout: "num_keys_recovered": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_omap": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_hit_set_archive": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_bytes_hit_set_archive": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_kb": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_kb": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_promote": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_high": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_flush_mode_low": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_some": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_evict_mode_full": 0, 2024-09-16T14:55:57.232 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_pinned": 0, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "num_legacy_snapsets": 0, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "num_large_omap_objects": 0, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_manifest": 0, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_bytes": 0, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "num_omap_keys": 0, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "num_objects_repaired": 0 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "up": [], 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "acting": [], 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "avail_no_missing": [], 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "object_location_counts": [], 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "blocked_by": [], 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "up_primary": -1, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "acting_primary": -1, 2024-09-16T14:55:57.233 INFO:teuthology.orchestra.run.smithi116.stdout: "purged_snaps": [] 2024-09-16T14:55:57.234 INFO:teuthology.orchestra.run.smithi116.stdout: } 2024-09-16T14:55:57.234 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2024-09-16T14:55:57.234 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-16T14:55:57.234 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T14:55:57.236 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T14:55:57.236 DEBUG:teuthology.orchestra.run.smithi116:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 1048576 -p test bench 60 write --no-cleanup' 2024-09-16T14:55:57.288 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:hints = 1 2024-09-16T14:55:57.288 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 1048576 for up to 60 seconds or 0 objects 2024-09-16T14:55:57.288 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Object prefix: benchmark_data_smithi116_28801 2024-09-16T14:55:57.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:55:57.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 0 0 0 0 0 0 - 0 2024-09-16T14:55:58.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 1 16 127 111 6.93709 6.9375 0.0195474 0.142685 2024-09-16T14:55:59.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 2 16 1863 1847 57.7144 108.5 0.00754612 0.0172758 2024-09-16T14:56:00.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 3 16 3618 3602 75.0356 109.688 0.00394261 0.0133126 2024-09-16T14:56:01.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 4 16 5371 5355 83.6649 109.562 0.00836121 0.0119325 2024-09-16T14:56:02.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 5 16 7133 7117 88.9551 110.125 0.00964317 0.011223 2024-09-16T14:56:03.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 6 16 8772 8756 91.2008 102.438 0.012108 0.0109443 2024-09-16T14:56:04.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 7 16 10336 10320 92.1354 97.75 0.0160135 0.0108358 2024-09-16T14:56:05.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 8 16 11864 11848 92.555 95.5 0.00735113 0.0107954 2024-09-16T14:56:06.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 9 16 13393 13377 92.8884 95.5625 0.0154836 0.0107544 2024-09-16T14:56:07.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 10 16 14833 14817 92.5988 90 0.00573924 0.0107912 2024-09-16T14:56:08.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 11 16 16248 16232 92.2199 88.4375 0.015584 0.010832 2024-09-16T14:56:09.289 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 12 16 17579 17563 91.4667 83.1875 0.0117803 0.0109213 2024-09-16T14:56:10.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 13 16 18944 18928 90.9926 85.3125 0.0106973 0.0109811 2024-09-16T14:56:11.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 14 16 20131 20115 89.7917 74.1875 0.0045787 0.0111311 2024-09-16T14:56:12.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 15 16 21483 21467 89.4382 84.5 0.00766348 0.0111748 2024-09-16T14:56:13.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 16 16 22747 22731 88.7854 79 0.00774013 0.0112564 2024-09-16T14:56:14.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 17 16 24024 24008 88.2572 79.8125 0.0163185 0.011319 2024-09-16T14:56:15.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 18 16 25142 25126 87.2357 69.875 0.0204917 0.011455 2024-09-16T14:56:16.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 19 16 26365 26349 86.667 76.4375 0.00514591 0.0115332 2024-09-16T14:56:17.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:56:17.291606+0000 min lat: 0.00156072 max lat: 0.916099 avg lat: 0.01162 2024-09-16T14:56:17.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:56:17.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 20 16 27536 27520 85.9927 73.1875 0.00672283 0.01162 2024-09-16T14:56:18.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 21 16 28726 28710 85.4392 74.375 0.0151966 0.0116962 2024-09-16T14:56:19.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 22 16 29927 29911 84.9672 75.0625 0.0111694 0.0117588 2024-09-16T14:56:20.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 23 16 31125 31109 84.5281 74.875 0.0136979 0.0118211 2024-09-16T14:56:21.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 24 16 32295 32279 84.0527 73.125 0.0169047 0.0118893 2024-09-16T14:56:22.290 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 25 16 33484 33468 83.6629 74.3125 0.00733939 0.0119472 2024-09-16T14:56:23.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 26 16 34581 34565 83.0819 68.5625 0.0154457 0.012029 2024-09-16T14:56:24.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 27 16 35716 35700 82.6319 70.9375 0.00766134 0.0120947 2024-09-16T14:56:25.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 28 16 36828 36812 82.1626 69.5 0.0104298 0.0121644 2024-09-16T14:56:26.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 29 16 37966 37950 81.7818 71.125 0.0194057 0.0122191 2024-09-16T14:56:27.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 30 16 39054 39038 81.3223 68 0.00998416 0.0122909 2024-09-16T14:56:28.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 31 16 40124 40108 80.8561 66.875 0.0177296 0.012359 2024-09-16T14:56:29.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 32 16 41177 41161 80.3858 65.8125 0.0172771 0.012434 2024-09-16T14:56:30.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 33 16 42291 42275 80.0595 69.625 0.0181376 0.0124853 2024-09-16T14:56:31.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 34 16 43312 43296 79.5815 63.8125 0.00566192 0.0125453 2024-09-16T14:56:32.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 35 16 44271 44255 79.02 59.9375 0.0184955 0.0126476 2024-09-16T14:56:33.291 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 36 16 45051 45035 78.1791 48.75 0.0248278 0.0127824 2024-09-16T14:56:34.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 37 16 46060 46044 77.7704 63.0625 0.00771231 0.0128528 2024-09-16T14:56:35.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 38 16 47041 47025 77.3371 61.3125 0.0151533 0.0129246 2024-09-16T14:56:36.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 39 16 48027 48011 76.9341 61.625 0.0135896 0.01299 2024-09-16T14:56:37.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:56:37.293335+0000 min lat: 0.00156072 max lat: 0.916099 avg lat: 0.0130365 2024-09-16T14:56:37.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:56:37.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 40 16 49090 49074 76.6716 66.4375 0.0209621 0.0130365 2024-09-16T14:56:38.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 41 16 50100 50084 76.341 63.125 0.0129213 0.0130927 2024-09-16T14:56:39.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 42 16 51090 51074 75.9965 61.875 0.0108277 0.0131521 2024-09-16T14:56:40.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 43 16 52035 52019 75.6025 59.0625 0.0203907 0.0132193 2024-09-16T14:56:41.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 44 16 52917 52901 75.137 55.125 0.0274834 0.0133026 2024-09-16T14:56:42.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 45 16 53828 53812 74.7325 56.9375 0.0123996 0.0133735 2024-09-16T14:56:43.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 46 16 54786 54770 74.4094 59.875 0.0193773 0.0134333 2024-09-16T14:56:44.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 47 16 55619 55603 73.9338 52.0625 0.0167921 0.013519 2024-09-16T14:56:45.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 48 16 56505 56489 73.5471 55.375 0.0176766 0.0135897 2024-09-16T14:56:46.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 49 16 57271 57255 73.0231 47.875 0.00788547 0.0136873 2024-09-16T14:56:47.292 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 50 16 58120 58104 72.6238 53.0625 0.0181339 0.0137641 2024-09-16T14:56:48.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 51 16 58958 58942 72.2267 52.375 0.0207015 0.0138381 2024-09-16T14:56:49.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 52 16 59679 59663 71.7042 45.0625 0.0271502 0.0139377 2024-09-16T14:56:50.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 53 15 60461 60446 71.2746 48.9375 0.0207435 0.0140234 2024-09-16T14:56:51.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 54 16 61280 61264 70.9013 51.125 0.0150998 0.0140974 2024-09-16T14:56:52.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 55 16 62080 62064 70.5212 50 0.0267411 0.0141696 2024-09-16T14:56:53.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 56 16 62882 62866 70.157 50.125 0.0141032 0.0142478 2024-09-16T14:56:54.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 57 16 63623 63607 69.7386 46.3125 0.0072833 0.0143323 2024-09-16T14:56:55.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 58 16 64493 64477 69.4736 54.375 0.0200822 0.0143873 2024-09-16T14:56:56.293 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 59 16 65257 65241 69.1054 47.75 0.00993271 0.0144633 2024-09-16T14:56:57.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:56:57.295008+0000 min lat: 0.00156072 max lat: 0.916099 avg lat: 0.0145288 2024-09-16T14:56:57.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:56:57.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 60 11 66063 66052 68.7983 50.6875 0.0130651 0.0145288 2024-09-16T14:56:58.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Total time run: 60.0186 2024-09-16T14:56:58.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Total writes made: 66063 2024-09-16T14:56:58.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Write size: 65536 2024-09-16T14:56:58.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Object size: 1048576 2024-09-16T14:56:58.294 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Bandwidth (MB/sec): 68.7943 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Stddev Bandwidth: 19.3211 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Max bandwidth (MB/sec): 110.125 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Min bandwidth (MB/sec): 6.9375 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Average IOPS: 1100 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Stddev IOPS: 309.138 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Max IOPS: 1762 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Min IOPS: 111 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Average Latency(s): 0.01453 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Stddev Latency(s): 0.015726 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Max latency(s): 0.916099 2024-09-16T14:56:58.295 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Min latency(s): 0.00156072 2024-09-16T14:56:58.307 DEBUG:teuthology.orchestra.run.smithi116:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -p test bench 360 rand' 2024-09-16T14:56:58.309 INFO:tasks.radosbench:joining radosbench (timing out after 11100s) 2024-09-16T14:56:58.310 INFO:teuthology.orchestra.run:waiting for 11100 2024-09-16T14:56:58.352 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:hints = 1 2024-09-16T14:56:58.354 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:56:58.354 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 0 0 0 0 0 0 - 0 2024-09-16T14:56:58.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.358+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:56:58.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.374+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:56:58.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.378+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:56:58.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.390+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:56:58.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.462+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:56:58.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.462+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:56:58.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.514+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:56:58.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.530+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:56:58.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:56:58.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.554+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:56:58.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.582+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:56:58.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.606+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:56:58.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.610+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:56:58.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.614+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:56:58.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.630+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:56:58.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.650+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:56:58.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.666+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:56:58.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.678+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:56:58.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.722+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:56:58.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.750+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:56:58.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.750+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:56:58.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.754+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:56:58.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.754+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:56:58.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.766+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:56:58.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.814+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:56:58.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.834+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:56:58.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.834+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:56:58.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.862+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:56:58.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.870+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T14:56:58.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.894+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:56:58.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.914+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:56:58.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.930+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:56:58.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:56:58.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.966+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:56:58.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.970+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:56:58.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.974+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:56:58.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:58.986+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:56:59.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:56:59.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.010+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:56:59.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.018+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:56:59.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.022+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:56:59.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.046+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:56:59.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.066+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:56:59.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.086+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:56:59.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.086+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:56:59.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.094+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:56:59.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.134+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:56:59.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.134+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:56:59.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.146+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:56:59.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.178+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:56:59.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.210+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:56:59.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.218+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:56:59.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.222+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:56:59.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.250+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:56:59.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.250+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:56:59.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.250+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:56:59.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.294+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:56:59.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.294+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:56:59.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.330+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:56:59.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:56:59.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.346+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:56:59.354 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 1 16 10128 10112 631.926 632 0.000854412 0.0015678 2024-09-16T14:56:59.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:56:59.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.366+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:56:59.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.418+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:56:59.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.430+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:56:59.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.450+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:56:59.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.454+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:56:59.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.470+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:56:59.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.486+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:56:59.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.506+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:56:59.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.506+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:56:59.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.518+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T14:56:59.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.538+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:56:59.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.562+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:56:59.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.574+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:56:59.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.590+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:56:59.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:56:59.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.650+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:56:59.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.654+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:56:59.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.662+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:56:59.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.666+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:56:59.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.674+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:56:59.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.722+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:56:59.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.742+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:56:59.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.742+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:56:59.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.746+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:56:59.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.798+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:56:59.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.802+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:56:59.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.830+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:56:59.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.834+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:56:59.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.838+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:56:59.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.850+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:56:59.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.862+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:56:59.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.878+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:56:59.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.882+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:56:59.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.910+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:56:59.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.910+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:56:59.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.918+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:56:59.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.926+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:56:59.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.926+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:56:59.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.950+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:56:59.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.954+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:56:59.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.986+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:57:00.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:56:59.998+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:57:00.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.022+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:57:00.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.038+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:00.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.050+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:57:00.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.054+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:00.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.066+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:00.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.090+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:57:00.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.114+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:57:00.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.118+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:57:00.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.122+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:00.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.126+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:00.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.162+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:57:00.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.170+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:57:00.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.178+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:00.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.202+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:57:00.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:57:00.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.270+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:57:00.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.294+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:00.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.294+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:57:00.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.318+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T14:57:00.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.318+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:57:00.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.338+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:57:00.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.350+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:57:00.354 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 2 16 21098 21082 658.748 685.625 0.00150497 0.00150479 2024-09-16T14:57:00.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.366+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:57:00.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:57:00.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.398+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:57:00.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.434+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:57:00.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.434+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:57:00.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:57:00.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.474+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:57:00.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.490+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:57:00.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.494+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:57:00.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.510+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:57:00.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.522+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:57:00.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:57:00.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.582+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:57:00.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.582+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:00.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.582+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:57:00.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.598+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:57:00.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.610+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:57:00.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.634+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:57:00.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.642+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:57:00.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.650+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T14:57:00.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.670+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:57:00.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.678+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:57:00.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.678+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:57:00.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.678+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:57:00.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.702+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T14:57:00.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.714+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:57:00.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.738+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:00.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.750+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:57:00.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.766+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:57:00.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.786+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:57:00.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:57:00.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.810+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:57:00.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.826+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:57:00.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.838+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:00.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:57:00.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.862+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:57:00.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:57:00.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.886+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:57:00.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.890+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:00.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.902+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:57:00.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.906+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:57:00.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.926+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:57:00.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:57:00.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.966+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:00.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.982+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:57:01.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:00.998+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:57:01.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.014+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:57:01.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.046+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T14:57:01.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.054+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:57:01.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.054+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:57:01.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.062+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:57:01.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.062+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:01.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.090+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:57:01.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.102+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:57:01.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.110+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:57:01.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.126+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:57:01.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.126+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:57:01.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.170+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:57:01.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.186+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:57:01.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.214+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:57:01.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.218+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:57:01.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.222+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:57:01.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.238+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:57:01.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.246+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:57:01.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:57:01.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.330+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:57:01.354 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 3 16 30956 30940 644.522 616.125 0.00131367 0.0015366 2024-09-16T14:57:01.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.350+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:57:01.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.378+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T14:57:01.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:01.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.410+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:57:01.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.442+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:57:01.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.446+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:57:01.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.474+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:57:01.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.474+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:57:01.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.494+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:57:01.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.506+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:57:01.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.538+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:01.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.546+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:57:01.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.574+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:57:01.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.594+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:57:01.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.606+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:57:01.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.610+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:57:01.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.622+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:57:01.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.626+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:57:01.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.650+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:57:01.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.682+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T14:57:01.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.682+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:57:01.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.698+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:57:01.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.698+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T14:57:01.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.750+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:57:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.778+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:01.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.810+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:01.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.838+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:57:01.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.842+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:01.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:57:01.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.870+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:57:01.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.878+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:57:01.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.906+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:57:01.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.922+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T14:57:01.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.926+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:57:01.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.934+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:57:01.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.946+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:01.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.966+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:01.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.966+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:57:01.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.966+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:01.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.970+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:57:01.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:01.986+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:57:02.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.026+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:57:02.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.026+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:57:02.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.054+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:57:02.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.054+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:57:02.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.062+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:57:02.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.082+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:57:02.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.106+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:57:02.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.138+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:57:02.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.146+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:57:02.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.146+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:57:02.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.154+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:57:02.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.178+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:02.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.186+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:57:02.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.210+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:57:02.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.234+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:57:02.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.238+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:57:02.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.242+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:57:02.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:57:02.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.258+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:57:02.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.262+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:57:02.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.298+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T14:57:02.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.302+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:57:02.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.334+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:57:02.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.334+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:02.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T14:57:02.354 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 4 16 41586 41570 649.47 664.375 0.00205618 0.00152826 2024-09-16T14:57:02.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.354+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:57:02.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.366+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:57:02.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.390+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:57:02.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.398+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:57:02.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.422+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:57:02.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.430+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:57:02.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.462+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:57:02.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.486+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:02.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.498+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T14:57:02.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.506+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T14:57:02.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.530+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:57:02.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.542+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:57:02.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.578+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:57:02.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.582+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T14:57:02.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.610+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T14:57:02.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.610+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:57:02.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:02.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.654+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:57:02.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.670+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:57:02.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.682+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:57:02.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.686+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:57:02.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.694+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:57:02.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.722+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:57:02.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.742+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:02.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.762+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T14:57:02.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.774+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:57:02.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.778+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:57:02.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.794+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T14:57:02.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.798+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:57:02.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.830+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:02.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.838+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:57:02.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:57:02.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.870+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:57:02.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.874+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:57:02.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.894+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:57:02.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.910+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T14:57:02.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.942+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:02.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.958+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:57:02.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.962+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:57:02.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.974+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T14:57:02.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:02.978+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:57:03.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.002+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:57:03.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.022+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:57:03.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:57:03.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.038+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:57:03.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.046+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:57:03.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.066+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:57:03.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.082+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:57:03.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.086+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T14:57:03.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.094+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:57:03.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.110+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:57:03.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.158+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T14:57:03.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.158+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:57:03.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.170+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:57:03.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.178+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:57:03.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.182+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:57:03.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.190+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:57:03.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.210+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:03.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.214+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:57:03.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.218+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:57:03.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.282+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:57:03.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.290+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:57:03.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.290+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:57:03.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.318+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:57:03.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.330+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:57:03.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.342+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:57:03.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.342+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:57:03.355 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 5 16 52350 52334 654.115 672.75 0.00132183 0.00151762 2024-09-16T14:57:03.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.374+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:57:03.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.382+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:57:03.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.386+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:57:03.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.414+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T14:57:03.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.414+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:57:03.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.430+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:57:03.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.442+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T14:57:03.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.454+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:57:03.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.498+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:57:03.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.506+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T14:57:03.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.514+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:57:03.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.522+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:57:03.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.526+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:57:03.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.526+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:57:03.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.538+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T14:57:03.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.550+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:57:03.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.586+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T14:57:03.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.594+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:57:03.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T14:57:03.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.598+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T14:57:03.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.618+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:57:03.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.694+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:57:03.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.698+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T14:57:03.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.706+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:57:03.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.730+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:57:03.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.758+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:57:03.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.766+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:57:03.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.778+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:57:03.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.802+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:57:03.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.814+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:57:03.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.826+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:57:03.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.830+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:57:03.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.834+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:03.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:57:03.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:03.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.902+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:57:03.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.910+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:57:03.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.946+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:57:03.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.958+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:57:03.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.974+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:57:03.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.990+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:57:04.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:57:04.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.998+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:57:04.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:03.998+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:57:04.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.014+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:57:04.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.042+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:57:04.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.050+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:57:04.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.070+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:04.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.070+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:57:04.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.102+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:04.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.114+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:57:04.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.114+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:57:04.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.122+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:57:04.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.142+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:57:04.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.150+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:57:04.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.150+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:57:04.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.190+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:57:04.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.198+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:57:04.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.198+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:57:04.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:57:04.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.222+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:57:04.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.226+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:57:04.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.270+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:04.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.278+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:57:04.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.306+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:57:04.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.322+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:57:04.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.334+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:57:04.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.342+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:57:04.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.346+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T14:57:04.355 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 6 16 63390 63374 660.087 690 0.000758926 0.00150422 2024-09-16T14:57:04.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.374+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:57:04.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.390+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:57:04.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.422+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:57:04.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.430+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:57:04.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.446+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:57:04.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.454+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:57:04.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.462+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:57:04.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.478+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T14:57:04.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.482+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:57:04.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.510+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:57:04.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.514+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:57:04.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.530+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:04.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.546+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:57:04.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:57:04.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.558+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:57:04.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.562+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:57:04.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.578+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:04.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.594+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:04.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.610+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:57:04.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.614+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:57:04.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.630+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:04.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.634+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:57:04.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.658+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:04.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.666+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:57:04.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.666+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:57:04.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.706+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:57:04.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.710+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:57:04.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.710+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:57:04.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.718+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:57:04.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.742+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:57:04.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.742+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:04.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.758+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:57:04.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.766+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:57:04.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.778+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:57:04.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.790+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:57:04.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.790+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:57:04.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.806+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:04.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.822+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:57:04.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.834+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:57:04.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.838+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:04.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.878+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:57:04.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.878+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:57:04.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.886+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:57:04.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.906+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:57:04.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.910+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:57:04.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.930+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:57:04.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:57:04.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.974+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:57:04.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:04.990+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:57:05.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.022+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:57:05.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.022+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:57:05.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.030+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:57:05.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.054+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:57:05.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.070+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:57:05.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.090+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:57:05.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.098+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:57:05.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.114+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:57:05.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.122+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:57:05.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.122+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:57:05.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.166+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:57:05.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.166+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:57:05.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.174+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:57:05.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.190+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:57:05.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.190+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:57:05.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.202+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:57:05.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.230+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:57:05.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.254+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:57:05.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:57:05.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.270+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:57:05.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.290+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:57:05.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.306+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:57:05.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.318+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:57:05.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.322+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:57:05.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.330+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T14:57:05.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.338+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:57:05.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:57:05.355 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 7 16 73950 73934 660.067 660 0.00166269 0.00150356 2024-09-16T14:57:05.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.382+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:05.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:57:05.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.414+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:57:05.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.430+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:05.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.446+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:05.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.450+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:57:05.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.454+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:57:05.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.458+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:57:05.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.486+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T14:57:05.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.490+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:57:05.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T14:57:05.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.558+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:05.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.574+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:57:05.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.598+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:05.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.622+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:57:05.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.626+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:57:05.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.642+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:05.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.658+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T14:57:05.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.666+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:57:05.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.674+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:57:05.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.686+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T14:57:05.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.718+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:57:05.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.722+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:57:05.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.730+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:57:05.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.750+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:57:05.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.758+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:57:05.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.770+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:57:05.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.770+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:57:05.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:57:05.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.786+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:57:05.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.798+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:57:05.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.810+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:57:05.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.850+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:05.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.866+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:57:05.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:57:05.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.894+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:57:05.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.918+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:57:05.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.918+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:05.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.922+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:57:05.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.922+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:57:05.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.926+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T14:57:05.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.934+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:57:05.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:05.958+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:57:06.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.010+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:57:06.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.034+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T14:57:06.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.054+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T14:57:06.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.058+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:57:06.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.078+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:57:06.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.102+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:57:06.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.106+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:57:06.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.106+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:57:06.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.130+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:57:06.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.130+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:57:06.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.162+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:57:06.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.182+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:57:06.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.186+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:57:06.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.206+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:57:06.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.218+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:57:06.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.238+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:06.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.254+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:06.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.262+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:06.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.274+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:57:06.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.278+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:57:06.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.302+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:57:06.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.306+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:57:06.355 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 8 16 84324 84308 658.595 648.375 0.000903558 0.0014998 2024-09-16T14:57:06.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.394+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:57:06.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.410+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:57:06.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.422+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:57:06.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.454+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:57:06.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.462+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:57:06.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.490+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:57:06.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.506+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:57:06.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T14:57:06.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.526+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:57:06.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.542+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T14:57:06.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.558+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:57:06.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.558+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:57:06.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.570+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:57:06.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:57:06.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.618+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:57:06.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.638+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:57:06.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.650+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:57:06.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.654+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:57:06.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.702+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:57:06.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.706+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:57:06.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.714+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:06.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.718+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:57:06.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.742+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:06.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.746+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:57:06.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.770+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:57:06.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.794+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:57:06.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.802+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:57:06.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.810+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:57:06.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.818+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:06.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.850+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:57:06.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.858+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:57:06.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.866+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:57:06.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.890+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:57:06.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.890+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:06.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.918+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:57:06.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.918+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:06.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.918+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:57:06.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.938+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:57:06.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.966+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:06.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.970+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:57:06.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.970+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:57:06.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:06.986+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:57:07.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.010+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:07.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.010+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:57:07.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.026+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:57:07.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.038+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:57:07.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.070+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T14:57:07.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.074+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:57:07.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.074+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:07.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.102+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:57:07.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.118+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:07.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.122+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:57:07.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.146+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:57:07.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.166+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:07.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.198+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:07.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.202+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:57:07.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.214+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:57:07.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.218+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:57:07.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.230+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:57:07.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.230+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:07.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.246+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:57:07.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.278+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:57:07.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.278+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:57:07.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.290+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:57:07.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.306+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:07.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.306+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:57:07.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.342+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T14:57:07.355 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 9 15 94724 94709 657.641 650.062 0.001641 0.00151024 2024-09-16T14:57:07.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.354+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:57:07.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.358+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:57:07.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.378+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:57:07.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.394+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.394+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.410+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.422+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.450+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.462+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:07.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.462+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.490+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.502+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.518+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.534+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.534+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.570+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.574+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.574+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.574+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.606+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.610+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:07.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.614+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:57:07.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.626+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:57:07.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.650+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:57:07.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.674+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:57:07.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.698+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:57:07.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.702+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:57:07.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.738+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:57:07.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.750+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:57:07.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.766+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:57:07.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.774+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:57:07.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.822+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:57:07.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.822+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:57:07.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.834+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:57:07.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:57:07.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.866+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:57:07.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.894+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:07.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.898+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:57:07.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.902+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:57:07.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.918+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:57:07.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.926+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:57:07.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:57:07.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.946+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T14:57:07.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:57:07.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:07.998+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:57:08.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.010+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:57:08.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.026+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:08.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.030+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:57:08.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.042+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:57:08.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.058+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T14:57:08.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.074+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:57:08.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.086+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:57:08.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.090+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T14:57:08.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.114+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:57:08.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.114+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:08.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.138+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:57:08.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.138+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:57:08.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.154+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:57:08.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.166+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:57:08.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.166+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:57:08.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.186+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:57:08.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:57:08.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.250+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:57:08.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.254+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:08.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:57:08.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.322+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:57:08.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.330+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:57:08.355 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 10 16 105676 105660 660.316 684.438 0.000593223 0.00150402 2024-09-16T14:57:08.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.358+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:57:08.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:57:08.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.386+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:57:08.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.410+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:57:08.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.446+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:57:08.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.458+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:57:08.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.482+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:08.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.482+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:57:08.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.490+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T14:57:08.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.518+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T14:57:08.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.522+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:57:08.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.530+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:57:08.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.554+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T14:57:08.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.566+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:57:08.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.598+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:57:08.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.602+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:57:08.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.602+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:08.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:57:08.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.642+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:08.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.666+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:57:08.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.678+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:57:08.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.694+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:57:08.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.698+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:57:08.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.730+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:57:08.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.734+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:57:08.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.790+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:57:08.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.790+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T14:57:08.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.838+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:57:08.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.838+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:57:08.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.858+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:57:08.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.878+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:57:08.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.898+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:57:08.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.902+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:57:08.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.906+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:08.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.910+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:57:08.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.934+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:57:08.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.958+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:57:08.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.962+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:08.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.974+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:57:08.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.994+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:08.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:08.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T14:57:09.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.002+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:57:09.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.014+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:57:09.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.018+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:57:09.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.018+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:57:09.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.086+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:57:09.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.118+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:57:09.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.154+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:57:09.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.158+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:57:09.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.170+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:57:09.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.178+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:57:09.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.182+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:57:09.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.182+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:57:09.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.190+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:57:09.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.234+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:57:09.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.266+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:57:09.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.266+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:57:09.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.270+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:57:09.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:09.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.326+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T14:57:09.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:57:09.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.354+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T14:57:09.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.354+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:57:09.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 11 15 116957 116942 664.384 705.125 0.00151836 0.00149499 2024-09-16T14:57:09.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.382+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:57:09.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:57:09.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.394+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:57:09.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.398+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:57:09.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.430+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:57:09.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.442+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:57:09.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.474+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:09.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.494+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:57:09.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.498+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:57:09.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.514+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:09.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.518+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:57:09.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.522+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:57:09.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.534+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:57:09.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.550+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:57:09.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.586+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:57:09.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.594+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:57:09.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.598+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:57:09.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.606+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:57:09.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.610+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:57:09.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.614+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:57:09.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.646+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:57:09.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.658+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T14:57:09.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.666+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:57:09.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.718+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:57:09.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.734+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:57:09.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.750+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:57:09.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.758+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:57:09.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.758+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:09.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.770+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:57:09.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.786+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T14:57:09.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.826+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:57:09.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.826+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:57:09.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.834+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:57:09.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.842+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:57:09.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.874+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:57:09.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.906+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:57:09.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.910+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:57:09.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.914+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:57:09.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:57:09.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.970+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:57:09.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.974+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:57:09.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:57:09.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.986+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:57:09.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:09.986+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:57:10.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.038+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:57:10.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.046+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:57:10.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.058+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:57:10.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.086+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:57:10.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.130+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:57:10.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.146+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:57:10.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.154+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:57:10.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:57:10.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.182+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:57:10.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.202+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:57:10.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.202+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T14:57:10.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.242+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:57:10.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.242+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T14:57:10.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.242+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:57:10.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.254+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:10.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.290+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:57:10.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.322+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T14:57:10.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.334+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:57:10.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 12 15 128480 128465 669.029 720.188 0.00123685 0.00148464 2024-09-16T14:57:10.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.382+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:57:10.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.394+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:57:10.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.402+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:57:10.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.414+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:57:10.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:57:10.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.430+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:57:10.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.434+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:57:10.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.470+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:57:10.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.486+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:57:10.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.506+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:57:10.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.506+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:57:10.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.514+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:57:10.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.522+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:57:10.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.554+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:57:10.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:57:10.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.582+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:57:10.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.590+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:57:10.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.598+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:57:10.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.626+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T14:57:10.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.646+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:57:10.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.650+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:57:10.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.662+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:10.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.670+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:57:10.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.674+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:57:10.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.710+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:57:10.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.722+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:57:10.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.746+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:57:10.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.806+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:57:10.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.806+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:57:10.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.814+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:57:10.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.826+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:57:10.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.826+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:57:10.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.850+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:57:10.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.874+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:57:10.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.874+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:57:10.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.878+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:57:10.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.890+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:57:10.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.894+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:57:10.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.914+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:57:10.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.922+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:57:10.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:57:10.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.954+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T14:57:10.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.962+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:57:10.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.974+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:57:10.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.990+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:57:10.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:10.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:57:11.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.010+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:57:11.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.030+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:57:11.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.062+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:57:11.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.086+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:57:11.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.098+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:57:11.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.106+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:57:11.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.110+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:57:11.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.114+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:57:11.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.138+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T14:57:11.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.146+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:57:11.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.146+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:57:11.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.170+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:57:11.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:57:11.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.214+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:57:11.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.214+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:57:11.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:57:11.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.242+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:57:11.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.270+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:11.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.270+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:57:11.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.274+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T14:57:11.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.282+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:57:11.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.298+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T14:57:11.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.310+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:57:11.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.330+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:57:11.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 13 16 139553 139537 670.786 692 0.0010507 0.00148045 2024-09-16T14:57:11.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.358+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:57:11.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.362+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:57:11.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.378+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:57:11.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.410+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:57:11.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.434+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:57:11.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.442+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:11.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.458+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:57:11.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.466+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:57:11.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:57:11.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.494+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:57:11.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.510+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:57:11.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.530+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:57:11.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.538+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:57:11.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.574+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:57:11.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:57:11.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.594+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:11.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.610+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:57:11.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.610+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:57:11.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.626+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:11.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.638+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:57:11.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.666+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:57:11.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.666+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:57:11.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.682+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:57:11.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.702+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:57:11.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.710+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:57:11.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:57:11.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.742+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:57:11.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.746+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:57:11.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.754+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T14:57:11.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.790+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:57:11.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.806+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:11.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.810+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:57:11.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.826+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:57:11.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.830+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:57:11.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.838+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:57:11.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.858+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:57:11.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.882+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:11.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.890+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:57:11.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.906+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T14:57:11.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.906+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:57:11.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.910+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:57:11.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.922+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:57:11.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.934+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:57:11.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.942+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:57:11.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.986+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T14:57:11.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:11.994+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:57:12.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.010+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:57:12.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.018+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:57:12.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.034+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:12.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.074+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:12.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.090+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:57:12.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.114+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:57:12.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.118+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:57:12.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.142+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:57:12.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.150+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:57:12.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.166+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:12.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.174+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:57:12.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T14:57:12.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.194+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:57:12.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.250+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:57:12.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.254+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:57:12.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.262+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:57:12.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.274+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:57:12.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.282+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:57:12.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.286+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:12.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.290+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:57:12.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.330+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:57:12.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.338+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:12.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:57:12.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.346+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:57:12.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.354+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:12.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 14 16 150767 150751 672.931 700.875 0.00068669 0.00147566 2024-09-16T14:57:12.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.402+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:57:12.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.402+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:57:12.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.406+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:57:12.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.418+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:57:12.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.434+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:57:12.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.458+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:12.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.498+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:57:12.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.506+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:12.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.506+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:57:12.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.530+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:57:12.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.554+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:57:12.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.562+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:57:12.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.578+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:12.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.590+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:57:12.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.594+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:57:12.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.598+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:57:12.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.606+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:57:12.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.618+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:57:12.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.622+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:57:12.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.646+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:57:12.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.658+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:57:12.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.678+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:57:12.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.678+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:57:12.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.686+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:57:12.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.694+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T14:57:12.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.710+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:57:12.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.722+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:12.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.734+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:57:12.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.738+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:12.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.738+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:12.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.790+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:12.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.794+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:57:12.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.798+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:57:12.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:57:12.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.802+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:57:12.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.842+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:57:12.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.886+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:57:12.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.886+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T14:57:12.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.890+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:57:12.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.910+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:57:12.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.918+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:57:12.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:57:12.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.954+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:57:12.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.966+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:57:12.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:12.982+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:57:13.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.010+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:57:13.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.014+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:57:13.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.042+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:13.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.062+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T14:57:13.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.062+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:13.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.070+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:57:13.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.074+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:57:13.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.094+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:57:13.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.134+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:57:13.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.142+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:57:13.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.150+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:13.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.150+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:57:13.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.154+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:57:13.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.170+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:57:13.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.182+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:57:13.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.194+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:57:13.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.234+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:57:13.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.246+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:57:13.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.262+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:57:13.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.266+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:57:13.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.298+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:57:13.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.302+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:57:13.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.306+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:57:13.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:13.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.338+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:57:13.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 15 16 161513 161497 672.841 671.625 0.00125621 0.00147615 2024-09-16T14:57:13.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.362+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:57:13.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.377+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T14:57:13.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.393+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:57:13.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.405+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T14:57:13.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.405+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:57:13.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.421+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:57:13.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.465+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:57:13.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.473+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:57:13.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.505+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:57:13.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.509+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:57:13.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.509+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:57:13.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.513+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:57:13.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.545+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T14:57:13.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.553+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T14:57:13.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.557+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:57:13.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.573+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:57:13.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.597+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:57:13.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.621+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:57:13.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.621+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:13.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.653+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:57:13.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.657+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:13.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.661+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:57:13.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.677+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:57:13.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.685+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:13.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.701+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:57:13.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.729+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:57:13.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.737+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:57:13.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.737+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:57:13.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.753+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:57:13.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.773+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:57:13.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.789+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:57:13.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.797+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:57:13.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.797+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:57:13.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.797+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:57:13.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:57:13.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.813+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:57:13.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.821+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:57:13.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.873+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:57:13.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.881+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:57:13.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.885+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T14:57:13.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.917+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:57:13.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.933+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:57:13.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.937+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:57:13.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.941+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:57:13.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.957+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:57:13.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:13.993+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:57:14.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.001+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:57:14.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.005+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:57:14.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.049+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:57:14.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.085+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:57:14.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.113+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:57:14.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.117+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:57:14.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.125+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:57:14.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.133+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:57:14.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.161+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:57:14.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.197+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:57:14.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.209+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:57:14.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.213+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T14:57:14.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.221+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:14.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.221+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:57:14.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.261+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T14:57:14.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.277+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:57:14.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.289+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:14.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.293+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:57:14.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.313+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:57:14.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.333+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:57:14.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 16 16 172690 172674 674.445 698.562 0.000853379 0.00147271 2024-09-16T14:57:14.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.365+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T14:57:14.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.377+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:57:14.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.381+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:57:14.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.417+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:57:14.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.429+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:57:14.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.433+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:57:14.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.433+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:57:14.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.441+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:57:14.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.489+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:57:14.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.501+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:57:14.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.513+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:57:14.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.517+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:57:14.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.521+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:57:14.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.525+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:57:14.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.545+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:57:14.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.557+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T14:57:14.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.597+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:14.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.605+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:57:14.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.613+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:57:14.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:57:14.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.625+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:57:14.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.645+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T14:57:14.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.649+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:57:14.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.653+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:57:14.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.661+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:57:14.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.669+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T14:57:14.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.669+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:57:14.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.689+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T14:57:14.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.709+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:57:14.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.765+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:57:14.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.765+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:57:14.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.777+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:57:14.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.793+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:57:14.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.817+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:57:14.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.821+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:57:14.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.837+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:14.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.845+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:57:14.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.849+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:57:14.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.873+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:57:14.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.877+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:57:14.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.889+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:57:14.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.909+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:57:14.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.917+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T14:57:14.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.921+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:57:14.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.949+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:57:14.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.957+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:57:14.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:14.969+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:15.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.001+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:57:15.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.005+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:57:15.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.009+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:57:15.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.041+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:57:15.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.049+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:15.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.053+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:15.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.061+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:57:15.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.085+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:57:15.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.085+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T14:57:15.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.125+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:57:15.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.133+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:57:15.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.145+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:57:15.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.157+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:57:15.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.185+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:57:15.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.193+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:57:15.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.197+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:15.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.197+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:57:15.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.201+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:57:15.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.221+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:57:15.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.221+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:57:15.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.233+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:57:15.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.265+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:57:15.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.285+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:57:15.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.289+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:57:15.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.301+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:57:15.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.301+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:57:15.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.317+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:57:15.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.353+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:15.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 17 16 183422 183406 674.225 670.75 0.000831076 0.00147296 2024-09-16T14:57:15.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.365+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T14:57:15.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.385+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:57:15.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.393+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:15.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.397+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T14:57:15.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.437+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:15.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.453+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:57:15.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.461+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T14:57:15.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.473+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:57:15.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:57:15.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.489+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:57:15.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:57:15.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.545+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:57:15.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.553+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T14:57:15.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.561+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:57:15.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.577+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:57:15.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.577+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:57:15.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.581+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:57:15.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.589+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:15.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.621+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:57:15.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.629+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T14:57:15.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.665+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:57:15.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.697+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:57:15.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:57:15.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.729+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T14:57:15.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.757+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T14:57:15.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.765+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:57:15.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.781+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:57:15.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.789+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:57:15.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.817+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:57:15.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:57:15.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.861+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:57:15.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.869+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:57:15.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.873+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T14:57:15.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.873+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:57:15.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.925+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:57:15.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.929+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:57:15.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.941+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:57:15.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.981+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:57:15.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.985+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T14:57:15.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:15.985+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:57:16.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.009+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:57:16.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.013+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:57:16.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.049+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T14:57:16.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.061+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T14:57:16.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.089+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:16.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.117+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T14:57:16.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.125+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T14:57:16.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.133+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:57:16.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.145+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:57:16.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.181+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:57:16.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.181+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:57:16.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.209+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:57:16.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.213+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:57:16.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.221+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:57:16.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.233+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:57:16.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.233+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:57:16.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.249+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:57:16.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.277+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:57:16.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.285+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:57:16.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.301+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:16.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.321+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:57:16.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.325+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:57:16.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.329+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:57:16.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.341+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:57:16.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.345+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:57:16.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:16.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.353+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:57:16.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 18 16 194763 194747 676.143 708.812 0.00179993 0.00146885 2024-09-16T14:57:16.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.393+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:57:16.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.429+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:57:16.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.429+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T14:57:16.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.449+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:57:16.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.457+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:57:16.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.457+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:57:16.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.465+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T14:57:16.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.465+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:57:16.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.509+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:57:16.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.513+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:16.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.525+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:57:16.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.533+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:57:16.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.545+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T14:57:16.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.577+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:57:16.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.597+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:57:16.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.613+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:57:16.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.625+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T14:57:16.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.637+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:57:16.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.637+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:57:16.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.657+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:57:16.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.665+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:57:16.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.677+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:57:16.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.689+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:57:16.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.701+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:57:16.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.717+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:57:16.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.721+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:57:16.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.737+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:57:16.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.753+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:57:16.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.773+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:57:16.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.809+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:57:16.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.809+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:57:16.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.817+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:57:16.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.821+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:57:16.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.853+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:57:16.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.857+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T14:57:16.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.889+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:57:16.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.897+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:57:16.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.917+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:57:16.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.937+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:57:16.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.941+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:57:16.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.961+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:57:16.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.961+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:57:16.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.973+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:16.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.977+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:57:16.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.985+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:57:16.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:16.993+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T14:57:17.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.021+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:57:17.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.029+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:57:17.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.053+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:57:17.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.077+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:57:17.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.101+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:57:17.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.101+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:57:17.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.117+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:17.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.121+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:57:17.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.137+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:17.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.137+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:57:17.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.141+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:57:17.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.173+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:17.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.181+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:57:17.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.201+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:57:17.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.209+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:57:17.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.221+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:57:17.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.225+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:57:17.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.253+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:57:17.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.277+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:17.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.281+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:57:17.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.281+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:57:17.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.333+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:57:17.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.337+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:57:17.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.337+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:57:17.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.341+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:57:17.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.353+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:57:17.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 19 16 205685 205669 676.481 682.625 0.0019018 0.00146795 2024-09-16T14:57:17.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.385+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:57:17.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.409+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:57:17.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.441+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T14:57:17.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.449+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:57:17.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.461+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:17.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.461+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:57:17.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.465+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:57:17.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:57:17.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.509+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:57:17.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.509+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:17.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.521+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:57:17.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.549+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:57:17.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.553+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:57:17.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.561+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:57:17.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.597+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:57:17.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.617+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:57:17.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.621+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:17.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.645+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:57:17.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.649+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:17.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.649+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:57:17.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.673+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:57:17.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.701+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:57:17.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.717+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:57:17.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.737+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:57:17.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.757+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:57:17.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.757+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:57:17.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.781+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T14:57:17.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.793+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T14:57:17.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T14:57:17.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:57:17.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.833+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:57:17.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.837+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:57:17.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.841+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:57:17.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.853+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T14:57:17.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.861+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:57:17.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.877+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:57:17.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.897+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:57:17.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.905+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:57:17.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.913+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:57:17.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.913+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:57:17.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.929+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:57:17.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.965+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T14:57:17.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:57:17.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.977+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:57:17.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.981+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:57:17.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:17.981+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T14:57:18.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.009+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:57:18.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.041+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:57:18.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.057+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:57:18.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.065+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:57:18.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.073+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:57:18.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.089+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:18.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.101+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:57:18.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.109+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:57:18.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.137+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:57:18.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.169+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:18.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.177+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:57:18.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.181+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:57:18.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.185+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:57:18.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.217+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:57:18.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.221+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T14:57:18.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.237+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:57:18.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.245+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:57:18.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.281+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:57:18.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.293+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:57:18.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.321+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:57:18.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.325+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:57:18.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.353+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:57:18.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:57:18.357342+0000 min lat: 0.000220975 max lat: 0.11014 avg lat: 0.00146583 2024-09-16T14:57:18.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:57:18.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 20 15 216864 216849 677.592 698.75 0.00100683 0.00146583 2024-09-16T14:57:18.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.357+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:57:18.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.397+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:57:18.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.397+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:57:18.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.405+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:18.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.417+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:57:18.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.421+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:57:18.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.481+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:57:18.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:18.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.533+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T14:57:18.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.561+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:57:18.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.577+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:57:18.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.577+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:57:18.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.593+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:57:18.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.609+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:57:18.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.609+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:18.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:57:18.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.661+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:57:18.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.677+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:57:18.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.685+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:57:18.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.697+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:57:18.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.725+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:57:18.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.729+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:57:18.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.733+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:57:18.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.733+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T14:57:18.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.773+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:57:18.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.781+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:57:18.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.793+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T14:57:18.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:57:18.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.813+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:57:18.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.825+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:57:18.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.845+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T14:57:18.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.853+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T14:57:18.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.853+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:57:18.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.865+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:57:18.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.889+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T14:57:18.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.893+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:57:18.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.897+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:57:18.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.921+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:57:18.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.929+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:18.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.961+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:57:18.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:18.969+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:57:19.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.009+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:57:19.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.013+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:19.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.057+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:57:19.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.061+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:57:19.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.073+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:19.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.073+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:57:19.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.121+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:57:19.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:57:19.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.125+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:19.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.137+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:57:19.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.141+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:57:19.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.157+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:19.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.165+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:19.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.177+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T14:57:19.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.185+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:57:19.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.205+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:19.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.225+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:57:19.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.237+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T14:57:19.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.237+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:57:19.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.245+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:57:19.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.245+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:57:19.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:57:19.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.289+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:57:19.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.301+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:57:19.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.317+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:19.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.325+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:57:19.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.333+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:57:19.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.353+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:57:19.356 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 21 16 227853 227837 678.025 686.75 0.000738847 0.00146469 2024-09-16T14:57:19.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.373+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:19.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.373+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:57:19.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.385+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:57:19.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.417+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:57:19.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.421+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:57:19.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.449+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:57:19.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.453+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:57:19.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.469+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:57:19.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.473+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:57:19.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.493+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:57:19.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.509+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:19.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.517+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:57:19.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.541+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:57:19.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.553+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:57:19.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.561+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:57:19.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.565+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:57:19.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.577+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T14:57:19.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.577+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:57:19.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.585+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:57:19.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.621+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:57:19.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.625+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:57:19.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.653+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:57:19.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.669+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:57:19.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.677+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:57:19.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.693+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:57:19.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.697+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:57:19.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.701+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:57:19.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.705+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:19.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T14:57:19.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.753+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:19.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.769+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T14:57:19.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.769+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:57:19.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.773+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T14:57:19.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.777+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:19.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.845+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:57:19.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.845+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:57:19.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.849+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:57:19.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.881+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:57:19.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.885+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:57:19.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.897+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:57:19.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.917+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:19.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.917+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:57:19.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.921+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:57:19.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.949+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T14:57:19.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:19.977+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:57:20.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.005+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:57:20.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.033+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:57:20.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.033+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:57:20.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.033+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:57:20.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.037+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:57:20.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.061+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:57:20.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.069+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:57:20.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.069+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:57:20.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.101+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:57:20.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.109+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:57:20.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.141+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:57:20.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.149+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:57:20.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.185+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:20.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.189+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:20.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.205+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:57:20.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.233+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:20.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.241+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:57:20.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.245+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:20.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.261+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:57:20.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.273+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:57:20.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.297+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:57:20.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.305+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:57:20.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.305+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:57:20.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.325+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:20.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:20.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 22 15 238663 238648 677.917 675.688 0.000949822 0.00146516 2024-09-16T14:57:20.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.369+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:57:20.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.373+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:57:20.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.385+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T14:57:20.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.393+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:57:20.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.405+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:20.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.437+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:57:20.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.449+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:57:20.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.453+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:57:20.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.461+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:57:20.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.469+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T14:57:20.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.485+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:57:20.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.497+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:57:20.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.497+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:57:20.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.525+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:20.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.537+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:57:20.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.537+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:57:20.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.561+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:57:20.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.569+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:57:20.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.577+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:57:20.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.577+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:57:20.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.585+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:57:20.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.629+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:57:20.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.633+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:57:20.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.641+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T14:57:20.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.657+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T14:57:20.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.689+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:20.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.717+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:57:20.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.721+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:57:20.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.741+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T14:57:20.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.769+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:57:20.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.777+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:57:20.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.789+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T14:57:20.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.801+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:57:20.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.809+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:57:20.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.841+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:57:20.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.845+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:57:20.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.861+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:57:20.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.873+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:57:20.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.897+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:57:20.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.921+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:57:20.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.933+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:57:20.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.933+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T14:57:20.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.949+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:57:20.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.969+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:20.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.973+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T14:57:20.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:20.993+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T14:57:21.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.005+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T14:57:21.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.009+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:57:21.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.041+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T14:57:21.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.065+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:57:21.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.077+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:57:21.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.085+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:57:21.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.117+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:57:21.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:57:21.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.141+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T14:57:21.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.161+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:21.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.169+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:57:21.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.173+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:57:21.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.201+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:57:21.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.209+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:57:21.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.209+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T14:57:21.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.221+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:57:21.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.245+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:57:21.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.277+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:57:21.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.277+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T14:57:21.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.293+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:21.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.297+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:57:21.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.321+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:57:21.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.353+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:57:21.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.353+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:57:21.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 23 15 249841 249826 678.811 698.625 0.000856602 0.00146324 2024-09-16T14:57:21.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.377+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:57:21.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.381+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T14:57:21.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.409+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:57:21.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.413+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:21.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.433+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:57:21.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.461+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:57:21.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.465+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:57:21.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.469+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:57:21.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.477+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:21.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.517+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:21.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:21.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.537+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T14:57:21.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.553+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:57:21.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.561+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T14:57:21.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.577+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:57:21.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.585+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:57:21.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.617+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:57:21.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.653+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:57:21.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.653+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:57:21.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.653+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:57:21.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.705+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T14:57:21.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.737+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:57:21.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.741+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:57:21.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.765+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:57:21.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.769+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:57:21.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.789+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:57:21.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.789+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:57:21.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.809+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:57:21.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.825+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:21.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.841+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T14:57:21.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.849+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:57:21.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.857+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:57:21.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.857+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:57:21.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.865+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:57:21.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.885+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:57:21.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.925+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:57:21.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.941+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:57:21.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.969+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:57:21.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.973+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T14:57:21.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:21.997+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:22.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.009+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:57:22.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.029+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T14:57:22.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.037+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:57:22.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.045+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:57:22.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.077+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:57:22.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.085+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:57:22.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:57:22.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.129+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:57:22.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.133+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:57:22.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.133+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:57:22.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.137+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:57:22.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.153+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:57:22.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.169+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:57:22.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.189+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:57:22.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.193+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:57:22.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.201+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:57:22.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.229+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:57:22.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.237+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:57:22.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.245+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:22.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:57:22.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.285+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:57:22.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.293+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:57:22.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.297+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:57:22.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.305+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:57:22.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:57:22.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.337+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:57:22.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 24 15 261308 261293 680.385 716.688 0.000791854 0.00145978 2024-09-16T14:57:22.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.357+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:57:22.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.381+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:57:22.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.385+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:57:22.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.401+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:57:22.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.405+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:57:22.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.429+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:57:22.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.429+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:57:22.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.441+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T14:57:22.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.445+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T14:57:22.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.461+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:57:22.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.465+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:57:22.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.469+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:57:22.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.481+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:57:22.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.525+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:57:22.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.545+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:57:22.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.557+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:57:22.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.569+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:57:22.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.573+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:57:22.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.581+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:57:22.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.585+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:57:22.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.601+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:57:22.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.605+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:22.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.629+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:22.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.641+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T14:57:22.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.685+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:22.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.701+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T14:57:22.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.713+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:57:22.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.721+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:57:22.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.741+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:57:22.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.749+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T14:57:22.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.761+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:22.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.765+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:57:22.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.797+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:57:22.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.801+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:57:22.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.813+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:57:22.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.813+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:57:22.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.817+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:57:22.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.837+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:57:22.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.849+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:57:22.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.873+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:57:22.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.877+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:57:22.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.897+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:57:22.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.901+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T14:57:22.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.909+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:57:22.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.937+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:22.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.937+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:57:22.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.961+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:57:22.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.965+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:57:22.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:22.973+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:57:23.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.021+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:57:23.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.029+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:57:23.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.029+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:57:23.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.057+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:57:23.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.069+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:57:23.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.089+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:23.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.105+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:57:23.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.125+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:57:23.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.129+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:57:23.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.145+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:57:23.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.161+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:57:23.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.173+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:57:23.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.181+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:57:23.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.181+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:23.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.221+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:57:23.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.233+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:57:23.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.257+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:57:23.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.281+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:57:23.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.305+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:57:23.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.309+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:23.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.309+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:57:23.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 25 16 272276 272260 680.585 685.438 0.000944103 0.00145941 2024-09-16T14:57:23.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.361+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:57:23.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.389+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:23.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.437+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:57:23.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.437+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T14:57:23.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.445+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:57:23.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.493+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T14:57:23.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.505+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:57:23.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.505+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:57:23.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.513+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:23.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.537+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:57:23.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.561+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:57:23.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.565+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:57:23.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.589+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:57:23.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.597+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:57:23.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.609+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:57:23.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:57:23.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.641+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:57:23.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.649+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:23.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.713+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T14:57:23.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:57:23.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.729+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:57:23.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.745+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:57:23.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.749+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:57:23.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.753+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:57:23.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.789+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:57:23.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.809+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:57:23.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.817+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:57:23.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.829+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:57:23.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.837+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:57:23.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.841+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:57:23.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.845+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:57:23.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.857+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:57:23.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.881+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:57:23.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.905+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:57:23.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.921+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:57:23.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.933+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:57:23.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.945+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:57:23.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:23.989+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T14:57:24.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.009+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:57:24.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.013+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:57:24.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.013+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:57:24.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.061+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:24.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.065+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:57:24.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.069+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:57:24.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.081+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:57:24.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.093+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:57:24.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.105+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:57:24.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.121+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:24.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.137+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:57:24.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.137+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:57:24.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.161+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:57:24.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.169+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:57:24.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.185+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:57:24.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.209+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T14:57:24.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.225+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:57:24.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.237+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:57:24.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.241+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:57:24.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.249+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:57:24.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.249+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:57:24.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.301+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:24.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.313+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:57:24.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.329+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:57:24.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:57:24.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.353+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:24.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 26 16 283285 283269 680.871 688.062 0.000659334 0.00145875 2024-09-16T14:57:24.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.365+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:57:24.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.393+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:57:24.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.393+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:57:24.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.405+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:57:24.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.421+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:57:24.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.425+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:57:24.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.453+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:57:24.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.457+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:57:24.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.477+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T14:57:24.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.485+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:24.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.509+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:57:24.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.513+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:57:24.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.537+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:57:24.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.565+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:57:24.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.585+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:24.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.589+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:57:24.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.625+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T14:57:24.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.629+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:57:24.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.629+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:57:24.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.637+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:57:24.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.649+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:57:24.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.657+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:57:24.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.673+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:57:24.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.685+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T14:57:24.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.709+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T14:57:24.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.721+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:57:24.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.749+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T14:57:24.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.761+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:57:24.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.761+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:57:24.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.777+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:57:24.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.785+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:57:24.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:57:24.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.841+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:57:24.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.845+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:57:24.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.857+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:57:24.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.881+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T14:57:24.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.885+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:57:24.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.901+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:57:24.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.909+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:57:24.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.929+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:57:24.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.957+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:57:24.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.969+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:24.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.973+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T14:57:24.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.985+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:57:24.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:24.989+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:57:25.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.005+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:57:25.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.033+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:57:25.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.053+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:57:25.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.053+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T14:57:25.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.057+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:57:25.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.061+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T14:57:25.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.101+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:57:25.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.113+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:57:25.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.121+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:57:25.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.145+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:57:25.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.157+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:57:25.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.177+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:57:25.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.181+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:57:25.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.189+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:57:25.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.213+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T14:57:25.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.217+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:25.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.237+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:57:25.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.241+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:57:25.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.253+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:57:25.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.253+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:57:25.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.261+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:57:25.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.281+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:57:25.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.301+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:57:25.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.301+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:57:25.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.313+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:57:25.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.329+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:57:25.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.349+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:57:25.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 27 16 293912 293896 680.251 664.188 0.00104529 0.00146011 2024-09-16T14:57:25.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.369+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:57:25.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.377+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:57:25.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.401+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:57:25.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.417+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:57:25.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.421+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:57:25.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.433+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:57:25.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.437+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:57:25.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.445+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:57:25.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.449+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:57:25.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.473+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:57:25.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.485+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T14:57:25.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.529+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:57:25.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.533+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:25.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.565+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:57:25.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.577+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:57:25.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.585+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:57:25.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.589+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:57:25.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.593+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:57:25.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.597+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:57:25.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.613+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:57:25.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.629+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:25.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.629+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:57:25.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:57:25.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.661+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:57:25.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.673+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:25.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.673+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:57:25.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.717+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:57:25.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.737+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:25.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.737+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:57:25.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.749+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:25.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.789+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T14:57:25.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.797+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:57:25.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:57:25.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.809+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:57:25.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.825+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:57:25.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.829+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:57:25.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.865+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:57:25.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.869+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:57:25.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.869+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:25.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.897+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:57:25.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.905+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:57:25.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.905+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:57:25.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.929+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:57:25.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.949+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:57:25.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.957+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T14:57:25.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.969+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:57:25.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:25.977+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:57:26.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.017+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:57:26.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.029+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:57:26.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.045+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T14:57:26.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.049+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:57:26.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.057+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:57:26.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.057+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:26.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.101+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:26.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.109+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:57:26.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.121+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:57:26.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.149+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:57:26.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.149+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:26.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.149+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:57:26.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.173+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:57:26.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.197+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:57:26.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.221+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:26.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.253+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:57:26.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.265+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T14:57:26.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.305+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:57:26.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.309+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:57:26.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.313+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:57:26.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.329+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:57:26.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.345+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:57:26.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:57:26.357 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 28 16 304972 304956 680.641 691.25 0.000730773 0.00145924 2024-09-16T14:57:26.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.377+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:57:26.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.405+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:57:26.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.409+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:57:26.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.429+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:57:26.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.473+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:57:26.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.489+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:57:26.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.497+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:57:26.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.513+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:57:26.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.537+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:57:26.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.537+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:57:26.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.545+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:57:26.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.549+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:57:26.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.593+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T14:57:26.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.601+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:57:26.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.609+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:57:26.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.625+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:26.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.645+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:57:26.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.665+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:57:26.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.677+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:57:26.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.693+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:57:26.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.709+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:57:26.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.713+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:57:26.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.725+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:57:26.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.741+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:57:26.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.745+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:57:26.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.753+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T14:57:26.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.753+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:26.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.765+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:57:26.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.769+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:57:26.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.821+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:57:26.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.825+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T14:57:26.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.837+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:26.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.865+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T14:57:26.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.869+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:57:26.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.889+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:57:26.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.905+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:57:26.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.909+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:57:26.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.925+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:57:26.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.941+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:57:26.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.941+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:57:26.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.969+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:57:26.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:26.993+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:57:27.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.001+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:57:27.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.005+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:57:27.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.025+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:57:27.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.053+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:27.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.061+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:27.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.081+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:57:27.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.085+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:57:27.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.089+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:57:27.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.109+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:57:27.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.141+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:57:27.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.141+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:57:27.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.153+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:57:27.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.165+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:27.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.181+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:57:27.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.205+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:57:27.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.213+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:57:27.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.229+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T14:57:27.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.257+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:57:27.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.273+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T14:57:27.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.273+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:57:27.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.293+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:57:27.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.325+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:57:27.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.329+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T14:57:27.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.337+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:57:27.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.345+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:57:27.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 29 16 315899 315883 680.719 682.938 0.00449192 0.00145903 2024-09-16T14:57:27.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.361+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:57:27.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.365+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:57:27.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.377+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:57:27.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.397+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T14:57:27.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.405+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:57:27.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.405+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:57:27.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.465+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:57:27.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.473+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:57:27.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.485+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T14:57:27.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.489+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:57:27.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.497+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:57:27.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.513+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:57:27.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.565+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:57:27.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.569+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:57:27.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.601+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:57:27.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.601+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:57:27.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.605+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:57:27.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.605+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:57:27.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.621+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:57:27.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.665+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T14:57:27.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.665+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:27.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.689+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:57:27.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.697+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:57:27.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.701+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:57:27.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.705+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:57:27.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.729+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:27.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.769+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:57:27.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.769+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:57:27.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.773+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:57:27.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.813+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:57:27.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.833+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:57:27.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.837+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T14:57:27.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.853+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:57:27.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.861+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:57:27.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.865+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:57:27.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.881+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:27.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.901+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:57:27.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.917+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:57:27.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.921+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:57:27.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.965+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:57:27.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.985+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T14:57:27.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:27.989+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:57:28.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.009+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:57:28.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.017+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:57:28.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.029+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:57:28.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.037+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:57:28.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.049+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:57:28.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.057+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:57:28.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.065+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:28.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.069+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:57:28.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.101+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:57:28.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.109+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:57:28.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.109+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T14:57:28.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.145+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T14:57:28.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.161+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T14:57:28.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.181+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:57:28.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.185+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:57:28.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.193+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:57:28.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.213+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:57:28.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.221+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:57:28.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.225+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:57:28.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.253+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T14:57:28.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.281+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:57:28.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.301+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:57:28.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.305+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:57:28.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.305+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:57:28.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.333+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:57:28.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.349+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:57:28.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.353+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:57:28.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 30 16 326518 326502 680.149 663.688 0.000804688 0.00146037 2024-09-16T14:57:28.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.373+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:57:28.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.381+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:57:28.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.389+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:28.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.405+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T14:57:28.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.421+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:57:28.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.433+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:57:28.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.441+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:28.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.465+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:57:28.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.469+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:57:28.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.497+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:57:28.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.505+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:57:28.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.517+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T14:57:28.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.525+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T14:57:28.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.525+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:57:28.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.537+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:57:28.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.553+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:57:28.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.557+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:57:28.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.605+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:57:28.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.609+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:57:28.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.625+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:57:28.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:57:28.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.637+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:57:28.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.637+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:57:28.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.669+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T14:57:28.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.705+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:57:28.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.721+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T14:57:28.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:57:28.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.737+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:57:28.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.749+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:57:28.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.761+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:57:28.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.781+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:57:28.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.825+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T14:57:28.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.841+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:57:28.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.857+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:57:28.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.873+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:57:28.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.897+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:57:28.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.901+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:28.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.905+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:57:28.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.909+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:57:28.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.921+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:57:28.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.933+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:57:28.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.953+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T14:57:28.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.977+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:57:28.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:28.985+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:57:29.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.005+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:57:29.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.017+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:57:29.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.053+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:29.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.065+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:29.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.069+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:57:29.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.073+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:57:29.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.089+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:57:29.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.117+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:57:29.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.141+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T14:57:29.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.173+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:57:29.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.173+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:57:29.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.177+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:57:29.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.181+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:57:29.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.189+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:29.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.189+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:57:29.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.205+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:57:29.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.205+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:57:29.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.217+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:57:29.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.233+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:57:29.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.237+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:57:29.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.261+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:29.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.269+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:57:29.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.277+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:57:29.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.309+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:57:29.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.341+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:57:29.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.341+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:57:29.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.341+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:29.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 31 16 336858 336842 679.054 646.25 0.00104824 0.00146271 2024-09-16T14:57:29.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.357+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:57:29.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.357+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:57:29.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.393+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:57:29.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.405+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T14:57:29.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.405+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:57:29.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.433+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:57:29.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.461+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:57:29.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.477+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:57:29.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.477+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:29.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.477+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:57:29.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.505+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:57:29.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.521+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T14:57:29.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.521+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:57:29.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.533+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:57:29.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.545+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:57:29.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.553+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:57:29.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.569+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:57:29.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.573+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:57:29.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.589+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:57:29.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.605+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:57:29.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.613+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:57:29.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.617+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T14:57:29.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.653+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T14:57:29.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.661+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:57:29.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.689+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:57:29.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.689+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:57:29.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:57:29.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.705+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:29.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.733+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:57:29.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.741+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:29.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.773+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:57:29.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.789+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:57:29.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.797+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:57:29.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.833+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T14:57:29.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.837+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:57:29.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.841+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:57:29.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.861+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:57:29.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.901+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:57:29.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.949+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:57:29.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.949+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T14:57:29.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.969+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:57:29.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:29.989+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:57:30.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.001+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:57:30.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.013+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T14:57:30.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.037+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T14:57:30.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.053+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:57:30.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.065+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:57:30.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.085+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:57:30.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.093+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:57:30.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.097+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:57:30.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.109+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:57:30.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.157+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:57:30.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.169+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:57:30.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.185+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:57:30.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.189+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:57:30.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.205+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:57:30.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.237+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:57:30.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.253+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:57:30.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.273+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:57:30.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.281+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:57:30.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.301+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:57:30.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.313+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T14:57:30.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.329+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:57:30.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.341+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T14:57:30.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T14:57:30.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 32 16 347962 347946 679.519 694 0.000727121 0.00146173 2024-09-16T14:57:30.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.397+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:57:30.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.413+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:57:30.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.421+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:57:30.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.433+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:57:30.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.449+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:57:30.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.453+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:57:30.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.465+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:30.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.477+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T14:57:30.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.501+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:57:30.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.513+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:57:30.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.533+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:57:30.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.533+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:57:30.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.553+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:57:30.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.561+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:57:30.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.565+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:57:30.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.577+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:57:30.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.605+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:57:30.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.609+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:57:30.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.633+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:57:30.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.637+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:57:30.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.657+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:57:30.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.689+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:57:30.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.697+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:57:30.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.725+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:57:30.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.741+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:30.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.753+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:57:30.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.761+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:57:30.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.773+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:57:30.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.777+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T14:57:30.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.777+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:57:30.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.809+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:57:30.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.825+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T14:57:30.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.837+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:57:30.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.845+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:57:30.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.877+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:57:30.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.877+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:57:30.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.897+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:57:30.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.905+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:57:30.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.913+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:57:30.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.933+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:57:30.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.949+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:57:30.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:30.989+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:57:31.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.009+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:57:31.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.013+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:57:31.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.021+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:57:31.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.045+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:57:31.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.073+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:57:31.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.081+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T14:57:31.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.105+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:57:31.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.117+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:57:31.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.145+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:57:31.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.149+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:57:31.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.149+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:57:31.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.153+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:57:31.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.161+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:57:31.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.181+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T14:57:31.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.193+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:57:31.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.229+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:57:31.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.253+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:57:31.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.273+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:57:31.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.281+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:57:31.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.289+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:31.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.297+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:57:31.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:57:31.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.337+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:57:31.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.349+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:57:31.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 33 15 359044 359029 679.917 692.688 0.00121466 0.00146086 2024-09-16T14:57:31.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.381+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:57:31.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.385+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:57:31.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.389+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:57:31.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.397+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:57:31.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.437+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:57:31.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.457+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:57:31.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.457+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:57:31.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.465+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:57:31.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.497+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:57:31.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.497+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:31.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.505+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:57:31.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.517+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:57:31.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.521+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:57:31.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.553+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:57:31.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.557+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:57:31.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.557+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:57:31.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.569+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:57:31.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.573+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:57:31.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.593+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:57:31.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.601+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:57:31.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T14:57:31.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.625+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:57:31.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.649+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:57:31.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.677+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:57:31.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.689+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:57:31.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.705+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:57:31.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.721+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:31.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.725+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:57:31.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.749+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:57:31.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.749+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:57:31.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.777+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:57:31.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.785+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:57:31.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.825+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:57:31.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.853+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:57:31.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.865+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T14:57:31.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.889+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T14:57:31.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.893+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:57:31.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.893+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:31.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.913+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:57:31.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.933+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:57:31.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.933+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:57:31.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.933+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:57:31.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.949+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:31.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.961+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:57:31.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:31.989+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:57:32.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.025+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:57:32.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.033+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T14:57:32.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.033+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T14:57:32.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.053+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:57:32.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.085+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:57:32.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.089+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:32.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.105+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:57:32.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:32.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.133+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:57:32.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.153+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:57:32.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.157+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:57:32.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.157+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:57:32.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.161+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:32.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.169+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:57:32.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.229+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:57:32.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.229+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:32.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.245+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:57:32.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.281+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:57:32.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.289+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:57:32.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.293+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:32.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.293+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:32.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.313+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:57:32.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.337+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:57:32.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.341+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T14:57:32.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 34 16 370008 369992 680.07 685.188 0.00275267 0.00146056 2024-09-16T14:57:32.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.373+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:57:32.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.377+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:57:32.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.421+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:57:32.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.441+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:57:32.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.441+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:57:32.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.457+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T14:57:32.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.465+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:57:32.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.485+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:57:32.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.489+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:57:32.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.509+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:57:32.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.513+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:32.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.525+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:57:32.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.529+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T14:57:32.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.537+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:32.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.553+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:32.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.577+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:57:32.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.597+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:57:32.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.597+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:57:32.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.609+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:57:32.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.617+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:57:32.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.621+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:57:32.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.645+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:57:32.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.645+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:57:32.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.657+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:57:32.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.685+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:57:32.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.701+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:57:32.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.717+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T14:57:32.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.737+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:57:32.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.741+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:57:32.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.801+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:57:32.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.801+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:32.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.825+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:57:32.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.837+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:57:32.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.841+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:57:32.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.845+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:57:32.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.853+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:57:32.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.885+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:57:32.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.917+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:57:32.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.929+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:57:32.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.949+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:57:32.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.957+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:57:32.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.973+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:57:32.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.989+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:57:32.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:32.997+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:57:33.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.013+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:57:33.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.025+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:57:33.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.065+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:57:33.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.077+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:57:33.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.077+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:57:33.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.105+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:57:33.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.125+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:57:33.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.129+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:57:33.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.133+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:57:33.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.173+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:57:33.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.181+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:57:33.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.189+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:57:33.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.205+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:57:33.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.217+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:57:33.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.217+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:57:33.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.233+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:33.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.249+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:57:33.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.269+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:33.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.273+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:57:33.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.313+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T14:57:33.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.313+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:57:33.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.321+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T14:57:33.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.337+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:33.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.345+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:57:33.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.353+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:33.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 35 16 381236 381220 680.688 701.75 0.00152596 0.00145917 2024-09-16T14:57:33.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.373+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:33.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.389+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:33.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.425+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:57:33.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.433+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T14:57:33.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.453+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:57:33.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.461+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:57:33.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.465+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:57:33.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.489+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:57:33.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.525+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:57:33.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.525+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:57:33.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.541+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:57:33.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.553+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:57:33.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.565+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:33.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.597+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:57:33.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.609+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:57:33.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:57:33.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.633+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T14:57:33.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.653+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T14:57:33.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.657+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:57:33.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.693+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:57:33.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.697+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:57:33.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.705+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:57:33.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.717+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:57:33.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.757+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:33.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.761+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:57:33.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.761+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:57:33.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.761+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:57:33.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.801+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:57:33.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.817+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:57:33.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.845+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:57:33.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.853+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:57:33.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.861+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:57:33.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.885+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:57:33.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.889+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:33.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.901+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:57:33.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.909+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:33.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.909+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:57:33.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.929+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:57:33.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.949+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:34.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.977+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:57:34.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:33.981+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:57:34.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.041+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:57:34.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.057+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:57:34.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.073+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:34.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.077+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:57:34.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.077+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:57:34.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.097+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:57:34.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.117+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:57:34.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.121+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:57:34.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.149+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:57:34.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.153+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:57:34.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.201+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:57:34.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.205+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:57:34.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.209+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:57:34.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.229+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:57:34.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.253+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:57:34.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.285+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:57:34.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.289+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:57:34.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.289+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:57:34.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.293+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:57:34.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.325+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:57:34.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.349+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:57:34.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 36 15 391864 391849 680.232 664.312 0.000578292 0.00146019 2024-09-16T14:57:34.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.373+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:34.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.377+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:57:34.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.377+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:57:34.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.385+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:57:34.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.417+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T14:57:34.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.417+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:34.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.417+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:57:34.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.425+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:57:34.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.441+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:57:34.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.445+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:57:34.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.525+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:34.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.529+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T14:57:34.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.545+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:57:34.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.553+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T14:57:34.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.569+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:34.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.573+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:57:34.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.581+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T14:57:34.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.589+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:34.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.597+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:57:34.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.617+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:57:34.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:57:34.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.637+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:57:34.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.653+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:57:34.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.661+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T14:57:34.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.677+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:57:34.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.713+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:57:34.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.717+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:57:34.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.741+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T14:57:34.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.757+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:57:34.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.773+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:57:34.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.785+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:57:34.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.801+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:57:34.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.801+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T14:57:34.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.821+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:57:34.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.833+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:57:34.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.841+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:57:34.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.933+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:34.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.965+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:57:34.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:34.997+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:57:35.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.005+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:57:35.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.021+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:57:35.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.049+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:57:35.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.073+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:57:35.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.089+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:57:35.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.097+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T14:57:35.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.101+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:57:35.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.105+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:57:35.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.121+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:57:35.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.165+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T14:57:35.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.169+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:57:35.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.177+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:57:35.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.189+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:57:35.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.189+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:57:35.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.209+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:57:35.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.209+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:57:35.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.253+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:35.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.257+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:57:35.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.261+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:57:35.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.301+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:57:35.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.305+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:57:35.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.309+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:57:35.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.313+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:57:35.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.345+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:57:35.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.349+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:57:35.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 37 16 402805 402789 680.325 683.75 0.000687736 0.00145997 2024-09-16T14:57:35.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.369+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:57:35.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.393+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:57:35.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.393+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:57:35.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.429+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:57:35.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.441+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:57:35.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.461+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:57:35.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T14:57:35.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.485+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:57:35.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.493+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:57:35.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.505+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:57:35.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.509+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:57:35.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.513+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:57:35.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.533+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:57:35.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.549+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:57:35.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:57:35.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.565+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:57:35.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.569+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:57:35.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:57:35.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.613+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:57:35.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.613+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:57:35.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.613+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T14:57:35.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.661+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T14:57:35.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.673+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:57:35.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.705+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:57:35.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.705+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:57:35.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.705+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:35.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.717+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:35.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.717+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:35.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.737+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:57:35.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.769+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:57:35.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.773+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:57:35.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.785+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:57:35.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.793+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:57:35.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.809+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:57:35.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.837+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:35.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.845+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:57:35.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.849+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:57:35.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.877+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:35.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.885+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:57:35.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.901+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:57:35.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.917+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:57:35.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.925+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:57:35.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.925+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:57:35.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.937+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:57:35.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.969+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:57:35.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.993+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:57:35.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:35.993+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:57:36.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.017+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:57:36.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.025+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:57:36.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.025+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:57:36.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.025+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:57:36.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.033+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:57:36.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.053+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:36.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.101+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:57:36.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.101+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:57:36.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.117+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:57:36.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.129+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:57:36.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.141+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:57:36.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.149+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:57:36.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.189+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:57:36.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.193+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:57:36.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.209+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:57:36.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.217+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:57:36.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.261+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:36.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.261+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:57:36.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.297+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:36.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.317+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:57:36.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.325+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:57:36.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.329+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:36.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.337+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:57:36.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T14:57:36.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 38 16 413637 413621 680.236 677 0.000748391 0.00146014 2024-09-16T14:57:36.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.361+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:57:36.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.369+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:57:36.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.389+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:57:36.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.397+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:57:36.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.445+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:57:36.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.461+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:36.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.469+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:57:36.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.485+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:57:36.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.497+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:57:36.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.501+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:36.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.513+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:57:36.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.521+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:57:36.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.593+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:57:36.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.617+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:57:36.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.617+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:36.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.637+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:57:36.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.641+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:57:36.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.645+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:57:36.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.653+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:57:36.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.657+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:57:36.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.681+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:57:36.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.713+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:57:36.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.725+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:57:36.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.733+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:57:36.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.745+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:57:36.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.761+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:57:36.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.761+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:36.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.773+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:57:36.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.773+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:57:36.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.793+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:57:36.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.817+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:57:36.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.833+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:57:36.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.845+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:57:36.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.845+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:57:36.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.849+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:57:36.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.861+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:57:36.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.917+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:57:36.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.921+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:57:36.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.933+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:57:36.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.941+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:57:36.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.969+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:57:36.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.973+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:57:36.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:36.977+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:57:37.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.021+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:57:37.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.025+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T14:57:37.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.037+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:57:37.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.049+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T14:57:37.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.077+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:37.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.089+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:37.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.133+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:57:37.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.153+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:57:37.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.157+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:57:37.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.181+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:57:37.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.185+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T14:57:37.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.205+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:57:37.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.209+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:57:37.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.209+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:57:37.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.257+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:57:37.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.265+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T14:57:37.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:57:37.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.277+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:57:37.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.289+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:37.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.333+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:57:37.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.341+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:37.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.349+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:57:37.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:57:37.358 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 39 16 424377 424361 680.005 671.25 0.00103495 0.0014607 2024-09-16T14:57:37.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.369+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:57:37.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.393+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:57:37.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.401+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:57:37.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:57:37.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.417+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:37.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.449+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:57:37.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.473+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:57:37.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.473+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:57:37.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:57:37.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.489+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:37.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.513+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T14:57:37.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.549+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:57:37.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.557+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:57:37.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.573+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T14:57:37.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.585+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:57:37.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.605+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:57:37.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:57:37.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.641+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:57:37.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.653+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:57:37.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.681+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:57:37.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.685+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T14:57:37.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.689+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:57:37.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.709+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:37.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.717+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:57:37.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.733+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:37.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.737+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:57:37.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.749+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:57:37.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.753+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:57:37.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.769+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:57:37.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.777+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:57:37.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.781+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:57:37.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.801+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:57:37.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.805+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:57:37.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.833+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:57:37.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.845+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:57:37.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.845+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:57:37.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.845+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:57:37.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.873+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:57:37.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.901+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:37.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.933+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:57:37.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.937+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:57:37.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.953+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:57:37.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.985+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T14:57:37.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:37.993+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:57:38.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.005+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T14:57:38.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.005+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:57:38.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.005+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T14:57:38.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.037+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:38.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.037+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:57:38.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.069+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:57:38.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.069+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T14:57:38.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.081+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:57:38.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.089+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:57:38.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.109+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:57:38.423 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:57:38.359128+0000 min lat: 0.000220975 max lat: 0.11014 avg lat: 0.00146265 2024-09-16T14:57:38.423 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:57:38.423 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 40 16 434663 434647 679.075 642.875 0.00088105 0.00146265 2024-09-16T14:57:38.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.117+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:57:38.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.165+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:57:38.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.177+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:57:38.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.181+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.185+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.193+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.197+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.217+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.221+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.233+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.241+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.257+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.277+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.289+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.309+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:57:38.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.317+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.329+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.353+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.357+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.373+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.397+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.401+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.413+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:57:38.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.421+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T14:57:38.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.429+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:57:38.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.457+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:57:38.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.465+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:57:38.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.481+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:57:38.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.485+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:57:38.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.485+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:57:38.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.509+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:57:38.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.561+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:57:38.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.565+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:57:38.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.573+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:57:38.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.601+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:57:38.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.605+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:57:38.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.609+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:38.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:57:38.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.633+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:57:38.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.653+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:57:38.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.657+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:57:38.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.657+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:57:38.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.669+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:57:38.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.673+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:57:38.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.701+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:57:38.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.721+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:57:38.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.729+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:57:38.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.753+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:57:38.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.757+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:57:38.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.761+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:57:38.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.765+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:38.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.801+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:57:38.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.805+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:57:38.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.825+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:38.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.849+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:57:38.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.861+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:57:38.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.865+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:57:38.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.869+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:57:38.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.869+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:57:38.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.893+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:57:38.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.929+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:57:38.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.933+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:57:38.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.933+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T14:57:38.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.941+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:57:38.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:38.945+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:39.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.065+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:39.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.077+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T14:57:39.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.089+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:57:39.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.105+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:57:39.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.109+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:57:39.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.113+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:57:39.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.149+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:57:39.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.165+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:57:39.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.169+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:57:39.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.193+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:39.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.193+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:39.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.213+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:57:39.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.217+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:57:39.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.241+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:57:39.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.257+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T14:57:39.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.277+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:57:39.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.309+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:57:39.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.313+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:57:39.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.325+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:57:39.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.337+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:57:39.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.341+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T14:57:39.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 41 15 444221 444206 677.082 597.438 0.00091026 0.00146698 2024-09-16T14:57:39.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.389+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:57:39.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.401+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:57:39.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.401+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:57:39.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.425+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:57:39.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.461+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:57:39.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.461+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:57:39.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.465+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:57:39.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.481+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:57:39.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.501+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:57:39.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.525+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:57:39.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.589+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:57:39.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.609+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:57:39.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.617+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:57:39.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.621+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:57:39.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.653+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:57:39.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.689+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:57:39.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.693+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:57:39.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.709+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:57:39.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.713+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:57:39.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.733+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:57:39.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.745+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T14:57:39.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.761+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:39.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.777+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:39.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.821+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:57:39.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.825+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:57:39.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.837+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:57:39.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.865+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T14:57:39.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.869+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:57:39.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.905+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T14:57:39.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.913+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:57:39.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.941+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T14:57:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.973+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:57:39.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.993+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:57:39.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:57:39.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.993+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:57:39.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:39.997+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:57:40.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.029+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:57:40.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.041+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:57:40.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.061+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:57:40.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.073+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:57:40.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.077+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:57:40.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.081+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:57:40.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.085+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:57:40.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.097+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T14:57:40.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.113+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:40.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.141+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:57:40.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.161+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:57:40.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.169+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:57:40.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.177+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T14:57:40.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.185+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:57:40.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.197+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:40.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.229+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:57:40.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.237+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:57:40.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.257+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:57:40.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.277+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:57:40.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.289+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:57:40.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.301+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:57:40.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.325+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:57:40.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.349+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:57:40.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 42 16 455443 455427 677.658 701.312 0.000993765 0.00146581 2024-09-16T14:57:40.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.373+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:57:40.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.389+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:57:40.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.393+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:57:40.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.429+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T14:57:40.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.429+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T14:57:40.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.437+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:40.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.449+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:57:40.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.473+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:57:40.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.509+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:57:40.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.513+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:57:40.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.525+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:57:40.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.529+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:57:40.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.533+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:57:40.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.581+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:57:40.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.581+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:57:40.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.589+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:57:40.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.605+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:57:40.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.613+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:57:40.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.621+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:57:40.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.621+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:57:40.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.677+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T14:57:40.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.681+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T14:57:40.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.693+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:57:40.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.725+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:57:40.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.729+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:57:40.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.733+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:57:40.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.741+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:57:40.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.749+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:40.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.753+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:57:40.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.773+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:57:40.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.813+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:40.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.821+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:57:40.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.825+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:57:40.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.841+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:57:40.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.869+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:57:40.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.885+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:57:40.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.893+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:40.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.933+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:57:40.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.941+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:57:40.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.953+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:57:40.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.957+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:57:40.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.965+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:57:40.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:40.985+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:41.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.029+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:57:41.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.041+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:57:41.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.041+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:57:41.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.053+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:57:41.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.065+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:57:41.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.089+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:57:41.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.097+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:57:41.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.133+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:57:41.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.133+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:57:41.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.137+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:57:41.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.173+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:57:41.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.173+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:57:41.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.181+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:57:41.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.209+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:57:41.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.225+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:57:41.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.237+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:57:41.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.237+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:57:41.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:57:41.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.269+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:57:41.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.281+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T14:57:41.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.293+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T14:57:41.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.313+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T14:57:41.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.325+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:57:41.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.329+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:57:41.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.341+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:57:41.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 43 16 466383 466367 677.798 683.75 0.00084816 0.0014655 2024-09-16T14:57:41.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.361+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:57:41.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.369+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:57:41.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.417+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:57:41.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.421+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:57:41.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.429+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:41.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.445+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T14:57:41.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.449+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:57:41.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.457+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:41.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.481+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:57:41.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.493+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:57:41.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.505+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T14:57:41.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.533+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:57:41.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.545+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:57:41.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.553+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T14:57:41.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.577+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:57:41.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.597+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:41.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.609+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:41.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.645+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:57:41.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.653+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:57:41.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.669+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:41.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:41.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.737+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:57:41.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.745+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:57:41.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.753+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:57:41.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.797+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:57:41.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.797+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:57:41.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.801+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:57:41.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.833+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:57:41.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.849+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:57:41.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.865+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:57:41.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.901+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:57:41.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.925+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:57:41.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.933+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T14:57:41.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.941+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:57:41.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.961+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:57:41.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.965+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:57:41.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:57:41.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:41.993+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:57:42.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.017+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:42.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.041+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:57:42.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.057+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:57:42.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.061+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:57:42.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.065+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:57:42.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.073+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:57:42.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.081+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:57:42.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.085+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:57:42.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.109+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:57:42.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.129+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:57:42.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.145+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:57:42.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.161+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:57:42.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.177+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:57:42.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.189+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T14:57:42.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.209+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:57:42.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.225+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T14:57:42.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.229+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:42.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.241+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:57:42.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.265+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:57:42.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.269+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:57:42.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.281+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:57:42.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.301+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:57:42.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.325+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:57:42.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 44 15 477423 477408 678.075 690.062 0.00102571 0.00146493 2024-09-16T14:57:42.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.361+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:57:42.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.361+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:57:42.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.405+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:57:42.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.417+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:57:42.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.421+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:57:42.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.441+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:57:42.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.457+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:57:42.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.465+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:57:42.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.485+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:57:42.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.509+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:57:42.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.509+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:42.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.533+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:57:42.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.537+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:57:42.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.541+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:57:42.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.541+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:57:42.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.577+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:57:42.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.585+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:57:42.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.605+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:42.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.613+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:42.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.629+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:57:42.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.633+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:57:42.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.633+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:57:42.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.641+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:57:42.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.649+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T14:57:42.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.673+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:57:42.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.697+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:57:42.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.697+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:57:42.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.701+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:57:42.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.713+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T14:57:42.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.781+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:57:42.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.785+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:57:42.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.813+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:57:42.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.817+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:57:42.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.833+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T14:57:42.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.865+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:57:42.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.881+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:57:42.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.901+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:57:42.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.909+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:57:42.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.917+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:57:42.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.921+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:57:42.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.925+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:57:42.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.973+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:57:42.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.985+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:57:42.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:42.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:43.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.001+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:57:43.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.009+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:57:43.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.009+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T14:57:43.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.065+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:57:43.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.069+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:57:43.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.069+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:57:43.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.081+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:43.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.109+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:57:43.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.117+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:57:43.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.121+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:57:43.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.137+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:57:43.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.149+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:57:43.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.153+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:57:43.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.153+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:57:43.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.193+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:57:43.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.205+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:57:43.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.205+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:57:43.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.209+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:57:43.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.213+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:57:43.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.213+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:43.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.265+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:57:43.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.281+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:57:43.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.289+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:57:43.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.289+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:57:43.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.293+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:57:43.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.297+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:57:43.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.309+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:57:43.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.333+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:57:43.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.349+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:57:43.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 45 16 488287 488271 678.093 678.938 0.000730945 0.00146483 2024-09-16T14:57:43.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.389+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:57:43.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.405+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:43.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.405+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:57:43.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.413+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:57:43.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.429+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:57:43.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.441+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:57:43.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.453+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:57:43.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.461+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:57:43.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.481+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T14:57:43.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.485+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:57:43.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.553+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:57:43.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.565+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:57:43.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.569+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T14:57:43.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.577+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:57:43.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.585+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:57:43.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.605+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T14:57:43.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.637+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:57:43.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.641+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:57:43.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.673+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:57:43.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.677+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:57:43.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.685+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:43.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.693+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:57:43.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.701+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:57:43.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.729+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:57:43.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.733+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:57:43.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.741+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T14:57:43.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.761+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:57:43.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.777+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T14:57:43.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.801+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:57:43.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:57:43.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.825+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:57:43.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.833+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:57:43.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.841+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T14:57:43.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.845+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:57:43.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.857+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:57:43.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.881+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:57:43.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.897+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:57:43.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.901+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:57:43.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.909+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:57:43.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.925+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:57:43.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.929+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T14:57:43.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.937+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:57:43.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.961+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:43.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.961+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:57:43.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:43.965+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:57:44.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.025+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T14:57:44.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.029+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:57:44.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.037+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:57:44.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.061+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:57:44.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.097+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:57:44.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.121+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:57:44.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.125+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:57:44.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.129+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:57:44.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.161+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:57:44.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.177+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:57:44.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.201+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:57:44.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.201+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:57:44.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.201+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:44.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.209+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:57:44.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.241+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:57:44.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.245+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:57:44.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.253+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T14:57:44.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.261+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:57:44.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.261+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:57:44.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.277+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:57:44.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.289+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:57:44.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.297+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:57:44.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:57:44.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.337+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:44.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.357+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:57:44.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 46 16 498814 498798 677.654 657.938 0.000841799 0.00146584 2024-09-16T14:57:44.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.369+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T14:57:44.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.373+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:57:44.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.393+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:57:44.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.397+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:57:44.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.421+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:57:44.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.429+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:57:44.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.433+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:57:44.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.449+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:57:44.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.489+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T14:57:44.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.497+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:57:44.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.501+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:57:44.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.513+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:57:44.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.525+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:57:44.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.541+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:57:44.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.581+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:57:44.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.581+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:57:44.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.589+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:57:44.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.597+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:57:44.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.597+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:57:44.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.629+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:57:44.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.661+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:57:44.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.673+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:57:44.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.673+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:57:44.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.693+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:57:44.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.717+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:57:44.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.721+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:44.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.753+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:57:44.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.773+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T14:57:44.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.773+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:57:44.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.825+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:57:44.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.841+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:57:44.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.845+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:57:44.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.865+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:57:44.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.865+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:57:44.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.873+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:57:44.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.893+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T14:57:44.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.905+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:57:44.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.905+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:57:44.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.941+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T14:57:44.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.949+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:57:44.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.953+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:57:44.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.969+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:57:44.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.977+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T14:57:44.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:44.993+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T14:57:45.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.005+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T14:57:45.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.017+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:57:45.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.025+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:57:45.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.045+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T14:57:45.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.085+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:57:45.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.085+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:57:45.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.093+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:57:45.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.109+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:57:45.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.113+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:57:45.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.125+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:57:45.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.137+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T14:57:45.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.141+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:57:45.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.165+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:57:45.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.197+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:57:45.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.201+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:57:45.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.201+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:57:45.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.245+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:57:45.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.249+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:57:45.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.261+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:57:45.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.269+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:57:45.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.281+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T14:57:45.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.301+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:57:45.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.301+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:57:45.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.328+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:57:45.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.340+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:57:45.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.356+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:57:45.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 47 16 509929 509913 678.015 694.688 0.000791165 0.00146505 2024-09-16T14:57:45.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.356+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:57:45.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.372+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:57:45.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.384+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:57:45.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.408+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:57:45.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.432+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:57:45.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.436+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:57:45.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.452+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:57:45.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.464+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:57:45.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.472+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:57:45.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.476+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:57:45.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.484+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:57:45.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.496+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:57:45.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.500+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:57:45.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.528+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:57:45.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.528+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:57:45.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.576+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:57:45.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.580+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:57:45.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.584+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:57:45.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.604+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:57:45.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.628+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:57:45.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.628+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:57:45.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.640+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:57:45.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.692+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:45.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.696+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:57:45.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.700+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:57:45.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.716+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:45.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.720+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:57:45.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.728+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:57:45.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.740+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:57:45.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.760+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:57:45.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.764+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:57:45.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.768+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T14:57:45.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.796+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:57:45.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.808+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:57:45.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.808+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:57:45.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.820+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:57:45.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.828+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:57:45.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.880+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:57:45.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.892+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:57:45.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.900+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:57:45.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.920+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:57:45.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.924+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:57:45.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.932+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:57:45.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.936+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T14:57:45.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.960+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:57:45.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.984+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:57:45.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.988+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:57:45.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.992+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:57:46.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:45.996+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:57:46.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.040+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:57:46.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.044+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:57:46.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.048+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:57:46.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.056+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:57:46.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.096+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:46.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.096+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:57:46.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.104+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:57:46.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.108+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:57:46.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.140+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:46.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.164+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:57:46.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.184+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:57:46.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.200+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:57:46.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.204+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:57:46.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.224+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:57:46.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.228+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:57:46.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.248+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:57:46.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.252+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:57:46.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.252+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T14:57:46.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.264+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:57:46.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.276+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:57:46.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.288+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:57:46.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.304+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T14:57:46.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.308+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:57:46.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.352+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:57:46.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 48 15 520631 520616 677.825 668.938 0.00127637 0.00146549 2024-09-16T14:57:46.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.360+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:57:46.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.384+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:57:46.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.384+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:57:46.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.388+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:57:46.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.416+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:57:46.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.432+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:46.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.440+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:57:46.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.448+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:57:46.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.452+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T14:57:46.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.488+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:57:46.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.496+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:57:46.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.500+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:57:46.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.512+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:57:46.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.516+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:57:46.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.524+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:57:46.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.556+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:57:46.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.592+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:57:46.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.592+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:57:46.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.616+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:57:46.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.616+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:57:46.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.628+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:57:46.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.652+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:46.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.664+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T14:57:46.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.688+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:57:46.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.692+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:57:46.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.732+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:46.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.752+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:57:46.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.760+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:57:46.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.784+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:57:46.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.800+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:57:46.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.816+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:57:46.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.836+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:57:46.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.852+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:57:46.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.872+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:57:46.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.880+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:57:46.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.888+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:57:46.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.892+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:57:46.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.908+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:57:46.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.928+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:57:46.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.936+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:57:46.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.984+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:57:46.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:46.996+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:57:47.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.000+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T14:57:47.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.020+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:47.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.036+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T14:57:47.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.052+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:57:47.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.076+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:57:47.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.080+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:57:47.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.080+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:57:47.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.084+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:57:47.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.096+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:57:47.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.124+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T14:57:47.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.140+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T14:57:47.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.140+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:57:47.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.148+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:47.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.168+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:57:47.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.176+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:57:47.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.208+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:57:47.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.232+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:57:47.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.236+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:57:47.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.260+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T14:57:47.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.264+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:57:47.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.272+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:57:47.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.272+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:57:47.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.280+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:57:47.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.320+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:57:47.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.344+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:57:47.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 49 16 531758 531742 678.182 695.375 0.00106951 0.00146468 2024-09-16T14:57:47.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.364+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:57:47.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.372+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:57:47.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.372+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:57:47.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.396+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:57:47.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.396+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:57:47.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.400+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:57:47.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.444+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:57:47.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.456+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:57:47.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.468+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:57:47.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.472+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:57:47.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.476+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:57:47.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.516+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:57:47.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.540+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:57:47.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.548+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T14:57:47.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.560+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:57:47.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.560+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:57:47.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.572+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:57:47.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.592+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:57:47.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.608+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T14:57:47.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.620+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:57:47.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.632+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:57:47.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.664+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T14:57:47.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.684+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:57:47.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.692+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T14:57:47.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.696+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:57:47.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.724+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:47.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.736+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:57:47.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.740+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:57:47.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.748+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T14:57:47.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.756+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:57:47.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.796+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:57:47.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.824+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:57:47.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.824+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:57:47.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.840+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:57:47.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.840+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:57:47.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.844+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T14:57:47.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.876+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T14:57:47.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.888+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:57:47.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.924+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:57:47.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.936+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:57:47.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.948+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:57:47.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.956+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:57:47.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.960+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T14:57:47.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:47.984+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T14:57:48.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.000+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:57:48.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.008+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:57:48.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.032+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:57:48.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.036+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:57:48.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.040+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:57:48.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.056+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:57:48.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.060+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T14:57:48.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:57:48.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.076+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:57:48.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.104+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:57:48.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.132+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:57:48.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.136+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:57:48.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.164+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:57:48.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.176+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:57:48.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.180+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:48.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.180+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:57:48.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.196+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:48.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.220+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:57:48.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.256+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:57:48.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.260+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:48.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.292+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:57:48.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.304+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:57:48.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.308+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:57:48.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.332+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:57:48.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.340+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:57:48.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.344+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:57:48.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.356+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:57:48.359 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 50 16 542824 542808 678.45 691.625 0.00149669 0.00146407 2024-09-16T14:57:48.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.380+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:57:48.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.384+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:57:48.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.432+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:57:48.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.444+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:57:48.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.460+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:57:48.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.464+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:57:48.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.468+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T14:57:48.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.472+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:57:48.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.472+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:48.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.544+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:57:48.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.560+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:57:48.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.576+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:57:48.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.584+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:48.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.620+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:57:48.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.632+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T14:57:48.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.640+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:57:48.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.656+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:57:48.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.696+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:48.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.700+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:57:48.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.716+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:57:48.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.748+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:48.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.760+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:57:48.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.776+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:57:48.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.780+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:57:48.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.780+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:57:48.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:57:48.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.820+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:57:48.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.824+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:57:48.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.860+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:57:48.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.872+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:57:48.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.900+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T14:57:48.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.908+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:57:48.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.932+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:57:48.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.948+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:57:48.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.952+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:48.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.964+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:57:48.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.964+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:57:48.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.976+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:57:48.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:48.988+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:57:49.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.008+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:49.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.012+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:57:49.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.012+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:49.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.032+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:57:49.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.052+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:49.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.068+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:57:49.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.084+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:57:49.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.084+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:57:49.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.120+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:57:49.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.128+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:57:49.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.128+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:57:49.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.136+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:57:49.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.164+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T14:57:49.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.172+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:57:49.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.192+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:57:49.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.236+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:57:49.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.272+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:57:49.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.276+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:57:49.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.280+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:57:49.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.288+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:57:49.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.296+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:57:49.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.300+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:57:49.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.320+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:57:49.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.348+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:57:49.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.348+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:57:49.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 51 16 554129 554113 679 706.562 0.000668619 0.00146286 2024-09-16T14:57:49.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.404+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:57:49.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.408+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:57:49.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.424+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:57:49.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.440+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:49.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.440+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:57:49.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.476+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:57:49.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.484+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:57:49.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.500+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:57:49.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.540+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:57:49.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.548+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:57:49.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.572+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:57:49.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.572+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:57:49.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.580+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:57:49.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.600+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:57:49.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.616+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:57:49.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.624+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:57:49.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.640+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T14:57:49.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.668+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T14:57:49.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.672+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:49.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.676+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:57:49.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.684+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:57:49.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.692+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:57:49.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.708+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:57:49.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.724+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:57:49.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.732+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:57:49.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.736+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:57:49.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.764+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:57:49.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.772+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:57:49.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.788+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:57:49.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.804+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:57:49.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.804+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:57:49.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.832+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:57:49.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.836+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:57:49.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.840+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:57:49.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.872+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:57:49.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.884+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:57:49.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.896+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:57:49.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.908+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:57:49.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.916+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:57:49.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.940+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:57:49.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:49.960+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:57:50.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.004+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:57:50.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.020+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:57:50.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.020+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:57:50.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.044+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:57:50.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.060+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:57:50.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.072+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:57:50.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.076+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:57:50.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.088+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:57:50.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.100+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:57:50.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.116+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:57:50.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.128+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:57:50.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.132+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:57:50.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.148+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:57:50.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.172+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:57:50.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.196+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:57:50.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.212+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:57:50.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.220+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T14:57:50.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.220+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:50.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.228+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:57:50.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.260+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:50.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.284+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:57:50.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.284+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:57:50.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.296+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:57:50.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.312+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:57:50.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.328+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:57:50.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.336+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:57:50.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 52 16 565072 565056 679.094 683.938 0.000949498 0.00146262 2024-09-16T14:57:50.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.356+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:57:50.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.376+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T14:57:50.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.380+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:57:50.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.400+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:57:50.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.400+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T14:57:50.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.432+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:57:50.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.432+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:57:50.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.444+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:50.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.468+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:57:50.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.476+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:57:50.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.496+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:57:50.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.500+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:57:50.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.524+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:57:50.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.532+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:57:50.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.572+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:57:50.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.572+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:57:50.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.588+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:50.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.608+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:57:50.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.636+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:57:50.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.640+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:57:50.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.648+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:50.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.656+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:57:50.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.656+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T14:57:50.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.660+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:57:50.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.684+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:50.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.704+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:57:50.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.708+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:57:50.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.720+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:57:50.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.744+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T14:57:50.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.752+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:57:50.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.772+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:57:50.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.788+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:57:50.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.804+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T14:57:50.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.808+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:57:50.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.852+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:57:50.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.856+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:57:50.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.864+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:57:50.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.872+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:57:50.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.872+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:57:50.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.912+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:57:50.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.936+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:57:50.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.948+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:50.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.988+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:57:50.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:50.996+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:57:51.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.004+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:57:51.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.016+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:57:51.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.020+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:57:51.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.044+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:57:51.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.068+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:57:51.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.072+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:57:51.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.080+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:57:51.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.100+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:57:51.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.100+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:57:51.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.108+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:57:51.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.148+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:57:51.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.172+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:57:51.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.180+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:57:51.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.200+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:57:51.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.208+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:57:51.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.228+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:57:51.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.228+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:57:51.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.228+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:57:51.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.244+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:57:51.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.264+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:57:51.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.268+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:57:51.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.292+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:57:51.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.292+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:57:51.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.320+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:51.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.332+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:57:51.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 53 16 575698 575682 678.81 664.125 0.00167715 0.00146332 2024-09-16T14:57:51.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.356+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T14:57:51.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.360+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:57:51.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.376+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T14:57:51.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.384+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:57:51.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.396+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:57:51.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.412+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:57:51.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.452+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:57:51.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.468+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:57:51.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.476+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T14:57:51.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.484+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:51.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.504+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:57:51.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.524+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:57:51.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.544+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:57:51.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.544+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:57:51.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.568+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:57:51.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.572+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:51.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.576+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:57:51.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.596+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:57:51.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.608+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:57:51.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.616+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:57:51.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.624+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T14:57:51.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.632+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:57:51.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.648+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:57:51.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.656+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T14:57:51.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.672+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:57:51.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.684+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:57:51.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.696+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:57:51.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.732+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:57:51.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.740+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:57:51.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.752+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:57:51.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.768+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:57:51.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.804+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:57:51.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.808+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:57:51.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.828+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:57:51.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.840+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:57:51.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.860+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:57:51.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.872+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:57:51.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.872+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:57:51.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.904+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:57:51.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.912+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T14:57:51.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.948+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:57:51.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.952+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:57:51.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:51.960+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:57:52.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.000+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T14:57:52.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.004+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:57:52.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.012+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:52.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.028+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:57:52.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.040+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:57:52.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.040+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:57:52.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.056+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:57:52.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:57:52.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.080+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:57:52.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.080+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:57:52.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.128+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:57:52.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.128+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:57:52.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.140+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:57:52.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.144+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:57:52.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.160+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:57:52.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.188+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:57:52.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.212+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:57:52.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.212+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:57:52.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.216+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:57:52.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.224+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T14:57:52.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.248+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:57:52.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.256+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T14:57:52.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.280+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:57:52.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.284+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:57:52.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.300+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:57:52.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.316+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:57:52.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.328+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:57:52.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.328+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T14:57:52.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.340+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:57:52.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 54 16 586420 586404 678.648 670.125 0.001358 0.00146362 2024-09-16T14:57:52.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.364+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:57:52.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.376+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:57:52.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.408+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:57:52.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.428+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:57:52.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.436+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:57:52.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.436+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:57:52.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.464+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:57:52.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.468+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:57:52.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.488+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:57:52.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.504+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:57:52.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.504+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:57:52.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.524+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:57:52.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.536+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:57:52.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.580+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:57:52.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.584+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:52.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.584+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:57:52.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.588+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:57:52.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.592+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:57:52.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.640+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:57:52.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.652+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:57:52.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.672+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:57:52.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.680+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:57:52.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.696+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:57:52.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.724+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:52.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.732+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:57:52.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.736+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T14:57:52.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.760+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:57:52.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.788+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:57:52.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.792+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:57:52.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.808+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:57:52.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:57:52.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.832+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:57:52.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.836+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:57:52.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.872+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:57:52.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.876+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:57:52.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.900+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:57:52.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.920+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:57:52.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.932+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:57:52.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.936+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:57:52.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.948+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:52.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.948+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:57:52.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.964+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:57:52.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:52.964+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:57:53.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.000+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:57:53.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.040+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:53.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.048+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:57:53.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.052+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:57:53.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:57:53.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.088+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:57:53.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.096+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:57:53.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.108+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:57:53.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.116+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:57:53.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.128+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:57:53.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.140+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:57:53.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.152+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T14:57:53.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.160+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:57:53.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.172+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:57:53.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.196+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:57:53.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.200+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:57:53.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.204+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:57:53.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.216+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:53.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.240+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:57:53.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.248+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T14:57:53.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.260+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:57:53.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.264+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:57:53.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.268+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:57:53.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.312+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:57:53.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.316+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:57:53.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.320+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:57:53.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.324+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:57:53.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.328+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:57:53.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 55 16 597535 597519 678.939 694.688 0.000773369 0.00146291 2024-09-16T14:57:53.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.360+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:57:53.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.364+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:57:53.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.376+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:57:53.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.388+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:57:53.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.388+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T14:57:53.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.420+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T14:57:53.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.440+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:57:53.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.440+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:53.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.472+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:57:53.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.480+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:57:53.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.496+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:57:53.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.508+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:57:53.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.516+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:53.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.552+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:57:53.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.568+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:57:53.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.600+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:57:53.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.600+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:57:53.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.628+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:57:53.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.640+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:57:53.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.656+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:57:53.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.680+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:53.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.696+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T14:57:53.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.708+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:57:53.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.712+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:57:53.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.736+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T14:57:53.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.740+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T14:57:53.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.752+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:57:53.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.776+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:57:53.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.792+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:57:53.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.792+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:57:53.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.796+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:57:53.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.804+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:57:53.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.868+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:57:53.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.872+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:57:53.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.888+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:57:53.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.916+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:57:53.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.940+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:57:53.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.944+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:57:53.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.952+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T14:57:53.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.960+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:57:53.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.972+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:57:53.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.976+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T14:57:53.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:53.980+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T14:57:54.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.000+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:57:54.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.012+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:57:54.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.048+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:57:54.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.060+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:57:54.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.080+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:57:54.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.092+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:57:54.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.104+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:57:54.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.108+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:57:54.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.116+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:57:54.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.124+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:57:54.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.132+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:54.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.152+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:57:54.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.176+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:57:54.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.180+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:57:54.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.180+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:57:54.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.192+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:57:54.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.212+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:57:54.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.232+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:57:54.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.248+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:57:54.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.252+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:57:54.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.260+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T14:57:54.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.288+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:57:54.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.292+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:57:54.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.304+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:57:54.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.304+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:57:54.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.324+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:57:54.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 56 16 608520 608504 679.074 686.562 0.00239276 0.00146274 2024-09-16T14:57:54.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.364+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:57:54.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.384+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:57:54.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.388+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:57:54.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.404+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:57:54.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.408+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:54.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.424+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:57:54.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.424+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:57:54.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.500+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T14:57:54.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.524+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:57:54.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.556+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:54.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.584+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:54.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.592+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T14:57:54.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.608+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:57:54.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.620+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:57:54.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.644+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:57:54.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.672+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:57:54.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.684+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:57:54.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.688+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:57:54.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.696+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:57:54.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.708+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:57:54.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.708+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:57:54.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.732+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:57:54.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.764+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T14:57:54.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.764+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:57:54.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.768+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:57:54.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.800+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T14:57:54.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.816+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:57:54.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.820+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:57:54.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.824+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:57:54.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.852+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:57:54.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.880+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:57:54.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.880+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:54.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.892+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:57:54.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.896+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:57:54.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.896+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:57:54.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.896+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:57:54.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.904+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:57:54.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:54.980+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:57:55.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.004+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:57:55.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.008+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:57:55.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.028+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:57:55.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.040+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:57:55.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.052+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:57:55.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.052+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:57:55.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.060+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:57:55.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.068+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:57:55.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.072+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:57:55.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.088+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:57:55.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.100+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:57:55.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.156+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:57:55.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.160+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T14:57:55.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.184+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:57:55.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.188+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:57:55.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.236+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:57:55.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.248+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:57:55.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:57:55.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.268+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:57:55.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.268+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:57:55.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.324+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:57:55.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.328+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:57:55.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.348+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:57:55.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 57 16 618845 618829 678.481 645.312 0.0014885 0.00146401 2024-09-16T14:57:55.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.360+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:57:55.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.364+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:57:55.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.368+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:57:55.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.388+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:57:55.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.412+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:57:55.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.412+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:57:55.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.440+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:57:55.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.440+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:57:55.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.468+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:57:55.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.476+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:57:55.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.488+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:57:55.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.516+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:57:55.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.532+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:57:55.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.556+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:57:55.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.556+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T14:57:55.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.564+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:57:55.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.584+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:57:55.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.620+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:57:55.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.668+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:57:55.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.676+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:57:55.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.684+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:57:55.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.700+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:57:55.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.708+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:57:55.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.724+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:57:55.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.728+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:57:55.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.736+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:57:55.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.748+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:57:55.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.760+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:57:55.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.760+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:57:55.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.780+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:57:55.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.788+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:57:55.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.816+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:57:55.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.828+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:57:55.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.848+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:57:55.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.848+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:57:55.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.852+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:55.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.872+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:57:55.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.892+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:57:55.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.892+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:57:55.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:55.940+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:57:56.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.000+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:57:56.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.008+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:57:56.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.020+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:57:56.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.044+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:57:56.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.048+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:57:56.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.056+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:57:56.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.088+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:57:56.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.112+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:57:56.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.124+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:57:56.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.152+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:57:56.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.176+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:57:56.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.192+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T14:57:56.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.196+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:57:56.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.196+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:57:56.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.200+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T14:57:56.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.232+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:57:56.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.248+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:57:56.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.268+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:57:56.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.272+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:57:56.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.280+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:57:56.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.312+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:56.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.328+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:57:56.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.356+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:57:56.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 58 16 629488 629472 678.251 665.188 0.0011068 0.00146454 2024-09-16T14:57:56.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.364+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T14:57:56.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.384+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:57:56.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.420+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:57:56.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.424+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:57:56.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.436+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:57:56.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.452+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:57:56.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.456+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T14:57:56.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.468+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:57:56.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.484+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:57:56.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.488+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:57:56.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.488+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:57:56.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.508+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:57:56.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.512+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:57:56.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.516+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T14:57:56.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.536+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:57:56.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.572+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T14:57:56.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.576+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:57:56.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.588+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:57:56.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.608+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:57:56.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.620+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T14:57:56.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.636+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:57:56.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.648+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:56.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.648+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:57:56.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.696+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:57:56.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.700+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:57:56.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.744+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:57:56.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.744+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:57:56.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.772+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:57:56.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.780+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:57:56.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.796+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:57:56.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.796+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:57:56.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.804+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:57:56.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.812+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:57:56.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.824+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:57:56.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.828+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:56.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.844+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:57:56.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.856+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:57:56.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.860+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:57:56.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.880+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:57:56.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.904+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:57:56.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.904+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:57:56.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.912+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:57:56.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.936+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:57:56.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.944+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:57:56.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.956+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T14:57:56.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.972+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:57:56.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:56.992+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:57:57.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.004+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:57:57.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.004+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:57:57.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.012+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:57:57.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.044+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:57:57.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.044+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:57:57.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.052+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:57:57.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.064+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:57:57.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.112+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:57:57.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.140+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:57:57.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.152+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:57:57.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.180+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:57:57.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.184+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:57:57.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.196+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:57:57.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.204+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:57:57.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.208+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:57:57.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.228+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:57:57.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.248+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:57:57.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.276+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:57:57.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.284+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:57:57.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.296+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:57:57.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.308+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:57:57.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.308+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:57:57.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.332+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:57.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.332+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:57:57.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 59 16 640603 640587 678.528 694.688 0.00125569 0.00146387 2024-09-16T14:57:57.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.372+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:57:57.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.376+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:57:57.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.376+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:57:57.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.420+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:57:57.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.424+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:57:57.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.432+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:57:57.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.460+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:57:57.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.472+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:57:57.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.480+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:57:57.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.488+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:57:57.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.500+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:57:57.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.508+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:57:57.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.508+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:57:57.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.548+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:57:57.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.564+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:57:57.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.564+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:57:57.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.564+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:57:57.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.576+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T14:57:57.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.616+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:57:57.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.632+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:57.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.636+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:57:57.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.644+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:57:57.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.660+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:57:57.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.680+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:57:57.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.724+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:57:57.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.728+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:57:57.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.744+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:57:57.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.756+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:57:57.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.756+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:57:57.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.800+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:57:57.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.820+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:57:57.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.844+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:57:57.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.844+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:57:57.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.852+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:57:57.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.864+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:57:57.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.884+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:57:57.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.924+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:57:57.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.936+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:57:57.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.940+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:57:57.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.944+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:57:57.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.952+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:57:57.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.956+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:57:57.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.980+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T14:57:57.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:57.992+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:57:58.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.008+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:57:58.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.028+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:57:58.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.048+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:57:58.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.076+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:57:58.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.096+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:57:58.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.100+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:57:58.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.132+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:57:58.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.136+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T14:57:58.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.140+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:57:58.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.156+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:57:58.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.156+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:57:58.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.204+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:57:58.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.212+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:57:58.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.232+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:57:58.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:57:58.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.272+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:57:58.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.304+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T14:57:58.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.312+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:57:58.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.336+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:57:58.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.340+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:57:58.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.356+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:57:58.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:57:58.360812+0000 min lat: 0.000220975 max lat: 0.121854 avg lat: 0.00146306 2024-09-16T14:57:58.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:57:58.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 60 16 651834 651818 678.917 701.938 0.000774913 0.00146306 2024-09-16T14:57:58.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.368+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:57:58.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.392+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:57:58.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.412+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:57:58.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.412+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T14:57:58.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.420+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:57:58.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.432+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:57:58.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.444+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:57:58.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.456+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:57:58.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.504+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:57:58.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.512+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:57:58.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.520+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:57:58.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.532+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:57:58.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.548+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:57:58.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.552+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:57:58.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.576+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:57:58.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.604+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:57:58.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.604+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:57:58.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.608+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T14:57:58.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.628+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:57:58.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.632+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T14:57:58.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.652+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:57:58.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.660+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:57:58.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.664+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:57:58.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.672+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:57:58.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.696+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:57:58.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.704+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:57:58.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.708+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T14:57:58.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.720+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:57:58.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.732+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:57:58.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.760+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:57:58.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.784+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:57:58.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.796+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:57:58.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.796+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:57:58.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.824+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:57:58.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.836+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:57:58.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.840+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:57:58.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.856+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:57:58.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.880+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:57:58.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.880+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:57:58.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.904+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T14:57:58.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.904+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:57:58.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.916+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:57:58.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.932+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:57:58.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.944+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:57:58.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.960+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:57:58.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.972+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:57:58.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.972+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:57:58.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:58.984+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:57:59.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.008+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:57:59.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.036+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:57:59.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.036+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:57:59.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.040+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:57:59.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.052+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:57:59.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.076+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:57:59.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.092+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:57:59.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.128+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T14:57:59.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.140+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:57:59.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.156+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:57:59.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.192+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:57:59.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.192+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:57:59.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.200+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:57:59.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.224+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T14:57:59.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.228+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:57:59.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.260+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:57:59.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.280+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:57:59.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.280+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:57:59.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.284+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:57:59.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.284+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:57:59.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.312+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:57:59.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.348+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:57:59.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.356+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:57:59.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.356+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:57:59.360 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 61 16 662834 662818 679.057 687.5 0.00170352 0.00146276 2024-09-16T14:57:59.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.368+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:57:59.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.388+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:57:59.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.388+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:57:59.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.448+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:57:59.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.456+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:57:59.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.464+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:57:59.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.492+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:57:59.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.496+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:57:59.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.520+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:57:59.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.524+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:57:59.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.536+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:57:59.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.556+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:57:59.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.564+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:57:59.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.568+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:57:59.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.596+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:57:59.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.608+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:57:59.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.612+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:57:59.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.628+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:57:59.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.684+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:57:59.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.704+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:57:59.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.704+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:57:59.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.716+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:57:59.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.752+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:57:59.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.760+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:57:59.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.760+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:57:59.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.792+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:57:59.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.800+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:57:59.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.804+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:57:59.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.808+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T14:57:59.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.856+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T14:57:59.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.872+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:57:59.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.888+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:57:59.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.904+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:57:59.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.916+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:57:59.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.928+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:57:59.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.932+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:57:59.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.936+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:57:59.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.972+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:57:59.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.972+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:57:59.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:57:59.976+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:58:00.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.000+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:58:00.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.056+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:58:00.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.064+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:58:00.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.072+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:58:00.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.084+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:58:00.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.104+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T14:58:00.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.108+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:00.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.136+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T14:58:00.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.144+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:58:00.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.144+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:58:00.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.148+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:00.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.152+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:58:00.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.164+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:58:00.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.200+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:58:00.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.236+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:58:00.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.236+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:58:00.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.240+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:58:00.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.268+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:58:00.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.280+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:58:00.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.292+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:00.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.296+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:58:00.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.324+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:58:00.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.328+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:58:00.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.328+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:58:00.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 62 16 673910 673894 679.269 692.25 0.00107421 0.00146223 2024-09-16T14:58:00.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.372+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:58:00.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.376+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:58:00.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.428+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:58:00.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.448+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:00.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.456+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:58:00.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.488+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:58:00.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.516+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:58:00.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.532+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:58:00.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.556+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:58:00.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.556+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:58:00.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.556+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:58:00.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.608+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:58:00.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.628+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:58:00.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.632+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:58:00.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.648+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:58:00.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.660+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:58:00.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.668+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:58:00.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.680+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:58:00.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.724+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:58:00.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.728+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:58:00.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.748+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:58:00.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.752+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:58:00.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.768+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:58:00.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.784+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T14:58:00.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.800+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:00.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.800+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:58:00.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.804+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:58:00.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.848+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:58:00.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.868+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T14:58:00.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.876+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:58:00.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.888+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:58:00.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.900+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:58:00.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.936+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T14:58:00.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.940+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:00.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.952+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:58:00.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.972+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T14:58:00.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.984+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:58:00.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.992+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:58:00.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:00.996+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:01.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.000+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:58:01.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.008+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:58:01.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.016+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:01.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.072+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:58:01.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.076+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:58:01.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.080+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:58:01.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.136+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:58:01.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.136+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:58:01.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.176+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:58:01.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.176+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:58:01.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.176+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:58:01.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.180+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T14:58:01.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.216+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:58:01.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.216+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:58:01.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.256+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:01.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.264+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:58:01.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.312+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:58:01.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.328+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:58:01.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.336+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T14:58:01.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.344+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:58:01.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 63 16 685441 685425 679.925 720.688 0.00071371 0.00146087 2024-09-16T14:58:01.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.360+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:58:01.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.372+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T14:58:01.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.380+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T14:58:01.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.400+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:58:01.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.412+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:58:01.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.424+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:58:01.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.440+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:58:01.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.440+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:58:01.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.456+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:01.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.504+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:58:01.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.528+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:58:01.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.528+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:58:01.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.536+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:58:01.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.556+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:58:01.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.560+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:58:01.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.584+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:58:01.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.596+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:58:01.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.600+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:58:01.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.612+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:01.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.612+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T14:58:01.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.628+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:58:01.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.640+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:58:01.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.652+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:58:01.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.660+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:58:01.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.704+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:58:01.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.708+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:58:01.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.716+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T14:58:01.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.736+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:58:01.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.736+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:58:01.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.752+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:01.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.768+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:58:01.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.772+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:01.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.796+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:58:01.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.820+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:58:01.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.836+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:01.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.844+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:58:01.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.844+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:01.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.848+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:58:01.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.872+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:01.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.924+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:58:01.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.936+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:01.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.944+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:58:01.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.960+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:58:01.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:01.964+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:58:02.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.020+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:58:02.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.032+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:58:02.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.048+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:02.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.060+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:58:02.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.080+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:02.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.084+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:58:02.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.108+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:58:02.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.120+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:58:02.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.144+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:58:02.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.160+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:58:02.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.168+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:02.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.196+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:58:02.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.204+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:58:02.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.216+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:58:02.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.220+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:58:02.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.232+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:58:02.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.236+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:58:02.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.268+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:58:02.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.272+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:58:02.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.316+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:58:02.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.348+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:58:02.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.352+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:02.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 64 15 696775 696760 680.37 708.438 0.000736727 0.0014599 2024-09-16T14:58:02.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.368+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:58:02.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.372+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:58:02.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.408+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:58:02.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.420+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:58:02.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.424+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:58:02.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.444+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T14:58:02.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.448+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:58:02.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.452+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:58:02.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.456+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:02.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.464+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:58:02.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.488+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:58:02.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.496+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T14:58:02.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.496+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:58:02.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.524+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:58:02.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.544+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:58:02.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.544+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:02.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.548+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:58:02.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.592+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:58:02.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.616+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:58:02.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.624+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:58:02.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.648+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:02.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.648+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:58:02.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.656+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:58:02.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.688+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:58:02.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.692+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:58:02.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.700+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:58:02.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.724+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:58:02.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.752+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:58:02.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.776+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:58:02.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.776+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:58:02.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.792+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:02.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.796+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:58:02.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.804+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:58:02.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.848+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:58:02.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.876+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:58:02.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.884+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:58:02.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.904+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:02.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.936+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:58:02.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.948+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:58:02.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.952+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:58:02.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.972+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:58:02.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.972+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:58:02.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.984+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T14:58:02.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:02.992+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:58:03.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.064+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:58:03.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.064+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:58:03.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.076+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:58:03.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.084+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:58:03.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.088+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:58:03.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.124+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:58:03.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.128+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:58:03.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.128+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:58:03.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.128+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:58:03.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.208+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:58:03.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.208+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:58:03.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.224+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:03.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.228+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:58:03.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.272+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T14:58:03.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.276+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:58:03.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.280+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:58:03.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.284+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T14:58:03.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.288+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:58:03.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.296+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:58:03.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.340+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:58:03.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.344+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:58:03.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 65 15 707831 707816 680.533 691 0.000737546 0.00145957 2024-09-16T14:58:03.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.364+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:58:03.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.368+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:58:03.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.380+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:58:03.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.388+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:58:03.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.440+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:58:03.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.460+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:58:03.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.484+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:58:03.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.488+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:58:03.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.492+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:58:03.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.492+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:58:03.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.500+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:58:03.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.532+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:58:03.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.544+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:58:03.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.548+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:58:03.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.572+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:58:03.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.592+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:58:03.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.608+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:58:03.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.612+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:58:03.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.616+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:58:03.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.652+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:03.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.680+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:58:03.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.688+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:58:03.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.700+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:58:03.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.708+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:58:03.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.712+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:58:03.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.728+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:58:03.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.740+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T14:58:03.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.752+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:58:03.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.764+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:03.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.768+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:58:03.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.796+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:58:03.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.816+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:58:03.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.844+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:58:03.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.848+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:03.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.864+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:58:03.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.892+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:03.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.900+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:58:03.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.904+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:58:03.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.940+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:58:03.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.964+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:58:03.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.972+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:03.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.976+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:58:03.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.988+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:58:03.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:03.996+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:58:04.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.004+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:58:04.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.052+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:58:04.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.072+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:58:04.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.080+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:58:04.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.112+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:04.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.128+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:58:04.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.128+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:58:04.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.144+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:58:04.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.156+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:58:04.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.184+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:58:04.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.188+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:58:04.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.200+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:58:04.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.220+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:58:04.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.224+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T14:58:04.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.228+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:58:04.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.244+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:04.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:58:04.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.268+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:58:04.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.296+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T14:58:04.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.316+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:04.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.328+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:58:04.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.332+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:58:04.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.348+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:58:04.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 66 16 718793 718777 680.601 685.062 0.0013165 0.00145944 2024-09-16T14:58:04.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.376+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:58:04.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.384+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T14:58:04.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.392+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:58:04.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.396+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:58:04.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.472+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:58:04.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.504+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:58:04.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.524+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:58:04.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.524+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:58:04.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.540+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:58:04.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.580+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:58:04.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.584+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:58:04.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.584+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:58:04.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.612+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:58:04.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.616+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:58:04.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.648+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T14:58:04.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.660+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:58:04.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.672+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:58:04.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.684+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:58:04.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.688+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:58:04.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.700+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T14:58:04.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.704+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:04.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.728+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T14:58:04.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.736+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:58:04.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.752+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:58:04.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.756+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:58:04.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.772+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:58:04.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.796+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:58:04.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:58:04.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.832+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:58:04.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.840+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T14:58:04.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.860+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T14:58:04.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.876+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:58:04.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.884+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T14:58:04.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.888+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:58:04.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.916+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:58:04.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.936+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:04.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.940+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:58:04.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.948+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:58:04.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.956+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:58:04.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.960+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:58:04.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:04.968+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:58:05.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.000+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:58:05.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.016+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:58:05.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.016+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:58:05.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.056+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:58:05.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.068+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:58:05.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.076+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:58:05.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.088+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:58:05.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.104+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:58:05.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.120+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:58:05.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.128+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:58:05.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.128+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:58:05.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.144+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:58:05.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.152+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:58:05.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.208+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:58:05.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.208+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:58:05.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.212+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:58:05.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.244+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:58:05.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.244+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:58:05.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.248+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:58:05.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.280+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:58:05.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.292+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:58:05.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.300+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:58:05.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.308+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:58:05.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.356+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T14:58:05.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 67 16 729337 729321 680.277 659 0.00117704 0.00146014 2024-09-16T14:58:05.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.384+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:05.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.400+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:58:05.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.400+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:05.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.400+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:58:05.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.408+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:58:05.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.432+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:58:05.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.436+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:58:05.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.460+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:58:05.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.484+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:58:05.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.484+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:58:05.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.496+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:58:05.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.516+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:58:05.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.524+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:58:05.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.536+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:58:05.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.548+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:58:05.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.568+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:58:05.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.572+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:58:05.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.652+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:58:05.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.680+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:58:05.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.680+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:58:05.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.696+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:58:05.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.716+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:58:05.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.720+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:58:05.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.724+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:58:05.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.752+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:58:05.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.752+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:58:05.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.760+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:58:05.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.780+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:58:05.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.804+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:58:05.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.812+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:58:05.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.832+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:58:05.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.832+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:58:05.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.856+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:58:05.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.860+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T14:58:05.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.876+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:58:05.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.892+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:58:05.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.908+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:58:05.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.920+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:58:05.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.924+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:58:05.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.936+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:58:05.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.948+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T14:58:05.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.960+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:58:05.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.980+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T14:58:05.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:05.980+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:58:06.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.004+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:58:06.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.004+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:58:06.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.012+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:58:06.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.048+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T14:58:06.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.064+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:58:06.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.088+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:58:06.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.092+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:58:06.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.112+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:58:06.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.120+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:58:06.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.140+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:58:06.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.152+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:06.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.160+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T14:58:06.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.192+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:58:06.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.192+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:58:06.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.200+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:58:06.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.232+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:58:06.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.236+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:58:06.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.256+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:58:06.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.284+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:58:06.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.284+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:58:06.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.308+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:58:06.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.316+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:58:06.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.320+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:58:06.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.328+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:58:06.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 68 16 740562 740546 680.59 701.562 0.000718768 0.00145943 2024-09-16T14:58:06.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.364+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:58:06.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.376+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T14:58:06.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.400+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:58:06.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.404+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:58:06.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.436+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:58:06.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.468+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:58:06.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.480+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:58:06.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.496+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:58:06.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.496+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:58:06.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.520+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:58:06.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.520+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:58:06.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.548+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:58:06.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.560+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:58:06.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.560+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T14:58:06.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.564+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:58:06.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.572+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:58:06.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.592+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:58:06.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.596+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:58:06.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.612+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:58:06.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.624+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:58:06.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.644+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:58:06.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.668+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:58:06.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.676+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:58:06.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.680+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:58:06.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.692+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:58:06.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.720+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:58:06.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.732+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:58:06.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.732+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:58:06.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.736+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T14:58:06.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.772+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:58:06.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.784+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:06.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.828+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:58:06.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.852+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:58:06.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.864+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:58:06.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.876+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:58:06.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.888+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:58:06.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.900+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:58:06.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.908+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:58:06.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.932+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:58:06.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.940+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:58:06.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.944+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:58:06.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.960+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:06.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.988+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:06.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.988+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:58:07.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.996+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:58:07.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:06.996+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:58:07.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.032+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T14:58:07.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.048+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:58:07.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.056+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:58:07.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.060+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:58:07.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.064+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:07.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.080+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:58:07.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.084+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T14:58:07.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.088+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:07.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.100+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:58:07.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.124+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:07.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.132+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:58:07.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.156+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:58:07.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.168+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:58:07.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.172+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:58:07.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.212+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:58:07.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:58:07.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.268+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:58:07.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.272+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:58:07.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.284+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:07.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.332+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T14:58:07.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.336+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:58:07.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.344+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:58:07.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 69 16 751871 751855 680.969 706.812 0.000783633 0.0014586 2024-09-16T14:58:07.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.360+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:58:07.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.368+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:58:07.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.388+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:58:07.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.388+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:58:07.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.396+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:58:07.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.408+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:58:07.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.436+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:58:07.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.448+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:58:07.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.452+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:58:07.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.460+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:58:07.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.504+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:58:07.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.536+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:58:07.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.536+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:58:07.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.572+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:58:07.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.576+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:58:07.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.600+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T14:58:07.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.620+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:58:07.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.620+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:07.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.648+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:58:07.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.708+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:58:07.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.736+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:58:07.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.736+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:58:07.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.744+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:58:07.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.760+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:58:07.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.792+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:58:07.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.800+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:58:07.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.824+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:58:07.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.828+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:58:07.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.852+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:58:07.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.868+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:58:07.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.876+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:58:07.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.892+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:07.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.896+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:07.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.924+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:58:07.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.955+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T14:58:07.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.959+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:58:07.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.967+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:58:07.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:07.971+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:08.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.007+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:58:08.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.011+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:58:08.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.015+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:58:08.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.051+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:08.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.055+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:58:08.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.091+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:58:08.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.095+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:58:08.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.095+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:58:08.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.123+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:58:08.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.143+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:58:08.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.155+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:08.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.159+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:58:08.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.159+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:08.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.171+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T14:58:08.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.215+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:58:08.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.243+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:58:08.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:58:08.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.255+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:58:08.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.267+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:58:08.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.275+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:58:08.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.279+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:58:08.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.295+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:58:08.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.355+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T14:58:08.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 70 16 763200 763184 681.354 708.062 0.000732662 0.00145781 2024-09-16T14:58:08.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.379+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:58:08.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.395+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:58:08.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.423+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T14:58:08.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:58:08.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T14:58:08.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.443+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:58:08.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.483+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:58:08.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.491+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:58:08.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.499+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T14:58:08.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.507+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:58:08.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.531+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:08.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.539+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:08.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.579+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:58:08.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.611+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:58:08.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:58:08.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.615+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:58:08.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.619+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T14:58:08.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.627+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:58:08.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.671+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:58:08.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.671+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:58:08.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.715+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:58:08.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.719+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T14:58:08.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.723+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:58:08.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.739+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:58:08.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.807+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:58:08.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.823+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:58:08.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.827+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:58:09.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.847+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T14:58:09.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.851+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:58:09.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:58:09.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.863+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.899+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.911+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.919+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.939+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.939+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.951+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.983+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:08.987+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.015+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:58:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.035+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.063+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.079+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.087+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.107+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.119+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.167+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.167+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.183+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:58:09.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.183+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:58:09.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.211+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:09.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.219+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:58:09.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.251+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:58:09.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.291+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:58:09.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.323+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:58:09.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.323+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:58:09.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.331+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:58:09.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:58:09.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.355+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:09.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 71 16 774865 774849 682.026 729.062 0.00174282 0.00145636 2024-09-16T14:58:09.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.395+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:58:09.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.403+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:58:09.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.411+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:58:09.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.423+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:58:09.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.443+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:58:09.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.447+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:09.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.475+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:58:09.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.487+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:58:09.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.495+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:58:09.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.503+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:58:09.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.519+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:58:09.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:58:09.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.535+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:58:09.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.559+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:58:09.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.559+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T14:58:09.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:58:09.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.603+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:58:09.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.611+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:58:09.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.623+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:58:09.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.627+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T14:58:09.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.647+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:09.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.663+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:09.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.667+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:58:09.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.683+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:09.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.703+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:58:09.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.719+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:58:09.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.727+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:58:09.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.735+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:58:09.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.775+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:58:09.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.775+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:58:09.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.799+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T14:58:09.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.799+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:58:09.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.807+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:58:09.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.839+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:58:09.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.851+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:58:09.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.875+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:58:09.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.883+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:58:09.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.887+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:58:09.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.915+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:58:09.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.915+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:58:09.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.923+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:58:09.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.947+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:58:09.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.955+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:58:09.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.971+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T14:58:09.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.987+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T14:58:10.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:09.999+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:58:10.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.003+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:58:10.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.007+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:58:10.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.019+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:58:10.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.019+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:58:10.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.079+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T14:58:10.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.079+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:58:10.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.103+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T14:58:10.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.111+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T14:58:10.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.119+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T14:58:10.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.119+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:10.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.135+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:10.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.159+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T14:58:10.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.179+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:58:10.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.179+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:58:10.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:58:10.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.207+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:58:10.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.215+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:58:10.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.219+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:58:10.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:58:10.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.247+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:58:10.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.291+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:58:10.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.299+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:58:10.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.323+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:58:10.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.335+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:58:10.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.351+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:58:10.361 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 72 16 785881 785865 682.115 688.5 0.00154836 0.00145617 2024-09-16T14:58:10.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.371+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:58:10.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:58:10.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.403+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:58:10.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.403+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:58:10.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.423+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:58:10.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.443+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:58:10.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.447+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:58:10.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.463+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T14:58:10.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.475+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:58:10.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.487+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:58:10.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.515+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:58:10.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.523+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T14:58:10.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.531+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:58:10.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.539+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:10.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.539+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:58:10.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.563+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:58:10.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.567+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:58:10.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.575+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T14:58:10.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.599+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:58:10.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.611+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:58:10.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.623+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:58:10.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.631+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:58:10.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.635+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:10.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.647+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:58:10.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:58:10.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.667+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T14:58:10.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.703+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:58:10.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.715+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:58:10.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.727+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:58:10.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.743+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:58:10.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.747+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:58:10.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.783+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:58:10.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.791+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:58:10.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.791+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:58:10.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.807+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:58:10.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.843+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:58:10.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.847+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:58:10.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.851+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:10.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.875+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:58:10.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.883+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:58:10.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.891+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:10.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.907+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:58:10.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.907+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:58:10.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.919+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:58:10.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.923+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:58:10.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.951+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:58:10.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.959+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:58:10.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.971+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:10.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:10.971+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:58:11.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.003+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:58:11.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.011+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T14:58:11.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.019+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:11.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.019+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:58:11.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:58:11.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.071+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:58:11.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.075+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:58:11.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:11.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.099+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:58:11.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.103+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:58:11.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.127+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:58:11.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.135+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:58:11.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.179+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:11.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.183+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:58:11.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.191+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:58:11.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.211+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:58:11.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.211+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:58:11.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.223+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:58:11.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:58:11.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:58:11.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.267+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:11.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.287+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:58:11.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.307+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:58:11.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.319+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:58:11.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.319+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T14:58:11.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.331+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:58:11.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.347+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:58:11.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:58:11.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.355+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T14:58:11.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 73 16 796958 796942 682.254 692.312 0.00123958 0.00145585 2024-09-16T14:58:11.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.379+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:58:11.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.403+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:58:11.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.455+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:58:11.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:58:11.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.459+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:58:11.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.487+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:58:11.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.507+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:58:11.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:58:11.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.515+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:11.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.519+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:58:11.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.531+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:58:11.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.563+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:58:11.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.563+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:58:11.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.583+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:58:11.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.591+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T14:58:11.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.599+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T14:58:11.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.639+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:58:11.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.647+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:58:11.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.655+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:11.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.671+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:58:11.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:58:11.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.687+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:58:11.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.695+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:58:11.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.719+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:58:11.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.719+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T14:58:11.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.723+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:58:11.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.767+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:58:11.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.775+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:58:11.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.791+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:58:11.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.819+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:58:11.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.823+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:58:11.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.839+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:58:11.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.839+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:58:11.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.843+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:58:11.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.851+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:58:11.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.879+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:58:11.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.895+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:58:11.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:58:11.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.899+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:58:11.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.903+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T14:58:11.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.931+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:11.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.955+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:58:11.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.975+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:58:12.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.995+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:58:12.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:11.999+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:58:12.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:58:12.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.027+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:58:12.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.051+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:58:12.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.059+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:58:12.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.063+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:12.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.071+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:58:12.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.083+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:58:12.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.111+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:58:12.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.115+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:58:12.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.131+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:58:12.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.131+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:12.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.135+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:58:12.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.139+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:58:12.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.159+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:58:12.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.187+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:58:12.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.207+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T14:58:12.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.219+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:58:12.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.227+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:58:12.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:58:12.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.247+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:12.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.255+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:58:12.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.267+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:58:12.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.291+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:58:12.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.311+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:58:12.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.331+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:58:12.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.339+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:58:12.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.351+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:58:12.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.355+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:58:12.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 74 16 808041 808025 682.394 692.688 0.000880102 0.00145557 2024-09-16T14:58:12.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.363+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:58:12.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.379+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:58:12.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.403+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:58:12.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.419+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:58:12.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.427+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:58:12.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.439+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:12.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.479+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:58:12.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:58:12.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.491+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:58:12.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.495+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:58:12.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.511+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:12.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.523+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T14:58:12.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.535+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:12.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.535+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:12.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.559+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:58:12.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.575+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:58:12.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.583+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T14:58:12.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.603+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:12.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.623+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:58:12.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.627+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:58:12.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.639+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:58:12.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.659+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:58:12.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.671+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:58:12.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:58:12.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.691+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:58:12.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.699+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:12.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.727+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:58:12.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.751+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:58:12.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.759+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:58:12.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.771+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:58:12.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.787+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:12.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.791+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:12.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.807+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T14:58:12.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.815+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:58:12.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.823+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:58:12.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.831+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:58:12.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.859+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:58:12.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.875+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:58:12.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.883+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:58:12.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.883+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:58:12.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.907+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:58:12.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.935+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:58:12.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.975+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:58:12.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:12.975+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:58:13.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:58:13.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.027+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:58:13.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.039+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:58:13.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.039+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:58:13.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.063+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:58:13.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.087+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:58:13.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.107+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:58:13.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.111+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:58:13.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.119+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:58:13.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.139+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T14:58:13.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.143+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:58:13.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.147+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T14:58:13.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T14:58:13.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.191+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:13.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.195+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:58:13.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.199+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:58:13.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.227+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:58:13.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.227+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:58:13.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.231+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:58:13.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.259+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:58:13.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.267+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:58:13.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.283+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:58:13.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.295+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:58:13.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.307+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:58:13.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.327+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:13.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:58:13.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.347+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:58:13.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 75 16 818943 818927 682.38 681.375 0.000641839 0.00145557 2024-09-16T14:58:13.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.383+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:58:13.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.419+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:58:13.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.427+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:58:13.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.455+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:58:13.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:58:13.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.479+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:58:13.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.483+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:58:13.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.511+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:58:13.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.523+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:58:13.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.527+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:58:13.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.559+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:58:13.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.563+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:58:13.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.563+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:58:13.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.607+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:13.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.611+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:58:13.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.611+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:58:13.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.611+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:58:13.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.643+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:58:13.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.655+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:58:13.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.663+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:58:13.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.679+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:58:13.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.679+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:58:13.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.683+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:58:13.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.703+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T14:58:13.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.703+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:58:13.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.751+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:58:13.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.751+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:58:13.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.763+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:58:13.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.791+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:58:13.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.799+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:58:13.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:58:13.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.843+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:58:13.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.851+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:58:13.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.883+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:58:13.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.911+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:58:13.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.911+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:58:13.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.919+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:58:13.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.923+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:58:13.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.943+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:58:13.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.947+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:58:13.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.955+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:58:13.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.983+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T14:58:14.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:13.995+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:58:14.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.003+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:58:14.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.011+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T14:58:14.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.019+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:58:14.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.023+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:58:14.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.055+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:58:14.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.063+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T14:58:14.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.067+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:58:14.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.087+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T14:58:14.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.099+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:58:14.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.099+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:58:14.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.119+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:58:14.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.131+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:58:14.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.147+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:58:14.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.163+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:58:14.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.187+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:58:14.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.207+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:58:14.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.219+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:58:14.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.231+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:14.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.235+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:58:14.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.251+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:58:14.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.271+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:58:14.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.283+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:58:14.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.291+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:58:14.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.315+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:58:14.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.323+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:14.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.331+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:58:14.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 76 16 830182 830166 682.643 702.438 0.00111609 0.00145505 2024-09-16T14:58:14.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.359+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:14.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:58:14.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.371+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:58:14.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.399+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:58:14.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.415+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:58:14.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.415+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:58:14.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:58:14.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:58:14.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.463+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:14.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.487+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:58:14.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.487+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:58:14.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.499+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:58:14.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.531+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:58:14.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.567+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:58:14.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.575+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:58:14.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.579+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:58:14.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.579+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:58:14.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.619+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:58:14.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.635+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:58:14.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.643+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:58:14.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.659+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T14:58:14.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.671+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:58:14.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.675+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:58:14.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.687+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:58:14.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.695+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:58:14.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.711+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:58:14.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.715+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:58:14.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.719+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:58:14.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.735+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T14:58:14.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.735+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:58:14.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.759+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:14.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.771+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:58:14.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.791+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:58:14.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.815+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:58:14.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.819+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:58:14.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.831+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:58:14.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.843+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:58:14.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.847+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:58:14.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.863+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:58:14.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.871+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:14.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.879+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T14:58:14.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.899+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:14.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.899+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:14.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:58:14.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.927+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:58:14.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.947+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:58:14.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.955+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:58:14.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.995+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:58:15.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:14.999+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:58:15.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.007+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:58:15.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.031+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T14:58:15.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.039+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:58:15.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.055+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:58:15.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.067+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:58:15.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.071+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:58:15.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.075+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:58:15.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.079+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:58:15.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.103+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:58:15.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.127+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:58:15.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.147+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T14:58:15.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.151+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:58:15.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.195+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:58:15.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.203+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:58:15.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.203+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:58:15.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T14:58:15.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.227+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:58:15.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.251+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:58:15.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.263+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:58:15.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.275+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T14:58:15.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.287+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:58:15.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.303+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:58:15.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.335+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:15.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.343+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:15.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:58:15.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.355+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:58:15.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 77 16 841168 841152 682.694 686.625 0.000616691 0.00145491 2024-09-16T14:58:15.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.363+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:58:15.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.363+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:58:15.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.375+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:58:15.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.399+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:58:15.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.407+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:58:15.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.427+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:58:15.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:58:15.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.439+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:58:15.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:58:15.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.491+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:58:15.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.495+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:15.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.499+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:58:15.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.543+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:58:15.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.567+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:58:15.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.571+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:58:15.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.611+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:58:15.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:58:15.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.635+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:58:15.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.635+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:58:15.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.647+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:58:15.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:58:15.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.659+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:58:15.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.687+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:58:15.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.691+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:58:15.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.727+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:58:15.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.739+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:58:15.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.739+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:58:15.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.759+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:58:15.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.763+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T14:58:15.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.771+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:58:15.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.775+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:58:15.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.783+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:58:15.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.831+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:58:15.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.855+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:58:15.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.855+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:15.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.859+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:58:15.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.899+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:58:15.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.903+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:58:15.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.907+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:15.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:15.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.927+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:58:15.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.947+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:58:15.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.955+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:58:15.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.963+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:16.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:15.999+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:58:16.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.003+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:58:16.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.031+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:58:16.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.039+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:58:16.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.043+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:58:16.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.047+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:58:16.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.047+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:58:16.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.095+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:58:16.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.107+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:58:16.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.123+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T14:58:16.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.139+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:58:16.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.139+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:58:16.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:58:16.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.187+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:58:16.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.203+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:58:16.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.219+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:58:16.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.223+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:58:16.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.227+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:16.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.227+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:58:16.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.243+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T14:58:16.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.251+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:58:16.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.259+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:58:16.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.283+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:58:16.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.303+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T14:58:16.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.335+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:58:16.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.343+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:58:16.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.347+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:58:16.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 78 16 851929 851913 682.563 672.562 0.00122622 0.00145519 2024-09-16T14:58:16.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.363+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:58:16.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.383+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:58:16.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.419+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:58:16.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.439+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:58:16.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.447+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:58:16.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.463+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T14:58:16.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.463+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:58:16.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:58:16.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.487+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:58:16.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.499+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:58:16.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.507+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:58:16.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.519+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:58:16.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.535+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:58:16.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.543+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:58:16.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.551+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:58:16.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.567+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:58:16.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.607+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:58:16.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.627+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:58:16.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.627+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:58:16.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:58:16.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:58:16.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.671+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:58:16.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.683+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:58:16.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.687+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T14:58:16.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.687+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T14:58:16.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.703+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:16.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.711+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:16.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.743+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:58:16.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.751+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T14:58:16.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:58:16.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:16.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.787+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:58:16.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T14:58:16.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.787+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:58:16.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.831+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:58:16.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.847+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:58:16.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.875+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:58:16.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.883+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:58:16.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.895+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:58:16.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:58:16.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.915+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:58:16.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.915+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:16.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.923+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:58:16.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.939+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:58:16.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.955+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T14:58:16.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.975+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T14:58:16.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.987+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:58:17.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.995+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:58:17.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:16.999+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:58:17.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.011+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:58:17.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.015+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:58:17.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.015+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:58:17.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:58:17.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.043+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:58:17.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.091+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:17.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.095+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T14:58:17.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.123+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:58:17.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.139+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:58:17.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.143+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:58:17.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.171+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:17.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.183+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:58:17.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.195+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:58:17.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.207+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:58:17.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.227+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T14:58:17.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.227+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T14:58:17.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.231+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:58:17.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.259+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:58:17.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.263+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T14:58:17.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.303+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:58:17.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.311+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:58:17.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.343+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:58:17.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:58:17.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 79 15 862856 862841 682.568 683 0.00384246 0.0014552 2024-09-16T14:58:17.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.371+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:17.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.375+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:17.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.379+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:58:17.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.403+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:58:17.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.411+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T14:58:17.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.423+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:58:17.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.435+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:58:17.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.439+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:58:17.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.439+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:58:17.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.459+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:17.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.479+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:58:17.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.499+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:58:17.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.507+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T14:58:17.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.515+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:58:17.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.535+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:58:17.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.547+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:58:17.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.551+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:58:17.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.559+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T14:58:17.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.579+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:58:17.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.587+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:58:17.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.591+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:58:17.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.599+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:58:17.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.643+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:58:17.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.651+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:58:17.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.667+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:58:17.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.667+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T14:58:17.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.687+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:58:17.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.703+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:58:17.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.707+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:58:17.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.727+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T14:58:17.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.735+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T14:58:17.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.739+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:58:17.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.743+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:58:17.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.751+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:58:17.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.755+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:58:17.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.779+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:58:17.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.795+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:17.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.831+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:58:17.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.839+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:58:17.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.867+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:58:17.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.883+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:17.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.883+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:58:17.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:58:17.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.935+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:58:17.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.939+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:58:17.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.939+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:58:17.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.951+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:58:17.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.959+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:58:17.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.967+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:58:17.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.971+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:58:17.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.987+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:58:18.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:17.999+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:18.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.043+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:58:18.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.059+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:58:18.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.059+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:58:18.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.063+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:58:18.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:58:18.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.095+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:58:18.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.099+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:58:18.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.135+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:58:18.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:58:18.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.147+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:58:18.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.171+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:58:18.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.179+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:58:18.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.187+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:58:18.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.207+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:58:18.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.223+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:58:18.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.243+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:58:18.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.251+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:18.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.259+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:58:18.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.283+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:58:18.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.299+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:58:18.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.303+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:58:18.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.307+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:58:18.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.323+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T14:58:18.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.327+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:58:18.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.343+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:58:18.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:58:18.362526+0000 min lat: 0.000220975 max lat: 0.121854 avg lat: 0.0014552 2024-09-16T14:58:18.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:58:18.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 80 16 873772 873756 682.562 682.188 0.00143113 0.0014552 2024-09-16T14:58:18.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.375+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:58:18.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.399+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:58:18.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.403+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:58:18.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:58:18.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.447+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:58:18.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.467+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:58:18.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.475+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:58:18.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.487+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:58:18.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:58:18.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.515+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:58:18.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.527+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T14:58:18.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.571+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:58:18.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.575+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:58:18.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:58:18.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.619+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:58:18.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.647+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:18.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.651+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:58:18.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.651+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:58:18.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.675+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:58:18.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T14:58:18.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.699+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:58:18.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.723+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:58:18.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.735+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:58:18.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.751+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:58:18.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.755+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:58:18.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.779+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:58:18.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.783+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:58:18.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.795+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:58:18.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.803+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:58:18.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.819+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:58:18.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.823+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:58:18.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.859+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:58:18.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.859+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:18.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.871+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:58:18.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.887+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:18.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.887+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T14:58:18.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:58:18.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.943+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:58:18.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.955+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:58:18.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.959+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:58:18.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.983+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:58:18.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.987+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:58:18.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:18.991+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:58:19.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:58:19.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.019+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:58:19.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.031+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:19.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.035+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:58:19.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.039+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:58:19.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.059+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:58:19.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.083+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T14:58:19.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.083+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:58:19.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.083+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:58:19.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.107+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:58:19.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.111+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:58:19.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:58:19.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.139+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:19.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.151+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:58:19.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.183+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:58:19.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.227+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:58:19.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.227+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:58:19.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.231+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:58:19.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:58:19.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.287+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:19.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.307+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:58:19.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.307+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:58:19.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.323+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:19.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.327+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:58:19.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.343+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:19.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.347+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:58:19.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 81 15 884908 884893 682.728 696.062 0.00115213 0.00145481 2024-09-16T14:58:19.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.375+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:19.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.375+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:58:19.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.387+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:58:19.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.423+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:58:19.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.423+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T14:58:19.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.439+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:58:19.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.459+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:58:19.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.467+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:58:19.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:58:19.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.483+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:58:19.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.487+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:58:19.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.491+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T14:58:19.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.523+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:58:19.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.539+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:58:19.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.543+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:58:19.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.551+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:58:19.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.571+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:58:19.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.583+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:58:19.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.615+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:58:19.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.619+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:58:19.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.635+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T14:58:19.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.639+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:58:19.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.671+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:58:19.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.687+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:58:19.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.715+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:58:19.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:58:19.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.743+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:58:19.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.747+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:58:19.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.759+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:58:19.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.763+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:58:19.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:58:19.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.791+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:19.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.791+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T14:58:19.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.799+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:58:19.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.819+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T14:58:19.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.835+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:58:19.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.847+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:58:19.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.871+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:58:19.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.883+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:58:19.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.923+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:58:19.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.939+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:58:19.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.963+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T14:58:19.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.971+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:58:19.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.979+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T14:58:19.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.987+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:58:19.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:19.987+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:58:20.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.019+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:58:20.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.067+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:58:20.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.071+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:58:20.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.083+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T14:58:20.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.083+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:58:20.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.095+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:58:20.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.111+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:58:20.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.119+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T14:58:20.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.143+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:58:20.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.147+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:58:20.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.159+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:58:20.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.183+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:58:20.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.191+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:58:20.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.195+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T14:58:20.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.215+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T14:58:20.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.231+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:58:20.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.243+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:58:20.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.251+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:58:20.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.303+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:58:20.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.303+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:58:20.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.307+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:58:20.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.319+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:58:20.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.343+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:58:20.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.355+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:20.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 82 16 896054 896038 682.896 696.562 0.000699852 0.00145449 2024-09-16T14:58:20.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.371+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T14:58:20.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.399+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:58:20.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.411+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:20.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.427+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:58:20.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.451+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:58:20.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.455+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:58:20.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.483+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:58:20.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:58:20.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.507+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:58:20.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.515+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:20.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.523+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:58:20.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.543+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:58:20.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.555+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:58:20.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.607+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:58:20.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.615+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:58:20.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.615+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:20.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.639+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:58:20.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.647+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:58:20.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.667+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:58:20.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.675+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:58:20.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.699+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:58:20.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.699+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:20.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.715+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:58:20.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.727+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:58:20.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.755+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:20.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.763+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:58:20.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.767+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:20.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.795+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:58:20.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.795+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:58:20.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.815+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T14:58:20.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.819+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:58:20.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:58:20.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.835+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:58:20.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.871+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:58:20.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.875+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:58:20.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.879+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T14:58:20.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.899+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T14:58:20.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.907+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:58:20.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.927+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:58:20.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.931+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:58:20.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.959+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:58:20.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.975+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T14:58:20.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:20.979+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:58:21.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.019+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:58:21.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.023+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:58:21.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.055+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:58:21.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.055+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:58:21.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.067+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T14:58:21.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.075+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:58:21.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.083+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:58:21.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.099+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:58:21.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.115+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:58:21.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.119+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:58:21.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:21.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.143+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:58:21.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.143+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:58:21.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.159+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T14:58:21.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:58:21.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.199+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:58:21.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:58:21.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.215+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:58:21.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.219+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:58:21.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.227+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:58:21.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.243+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:21.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:58:21.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.255+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:58:21.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.291+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:58:21.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.295+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:58:21.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:58:21.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.311+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:58:21.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.335+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:58:21.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.339+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:58:21.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.347+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:58:21.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.351+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:58:21.362 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 83 16 907015 906999 682.922 685.062 0.00129014 0.00145443 2024-09-16T14:58:21.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.367+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:58:21.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.379+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:58:21.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.395+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:58:21.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.399+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:58:21.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.403+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T14:58:21.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.403+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:21.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.427+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:58:21.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.439+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:58:21.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:58:21.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.447+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T14:58:21.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.463+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:58:21.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.487+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:58:21.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:58:21.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.507+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:58:21.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.519+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:58:21.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:58:21.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.543+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T14:58:21.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.559+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:58:21.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.575+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:58:21.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.595+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:58:21.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.607+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:58:21.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.615+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:58:21.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.615+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:58:21.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.643+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:58:21.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.663+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:21.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.667+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:58:21.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.679+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:58:21.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.679+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:58:21.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.699+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:58:21.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.711+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:58:21.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.747+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:58:21.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.751+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:58:21.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.759+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:58:21.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.791+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:58:21.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.791+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:58:21.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.823+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T14:58:21.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.835+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:58:21.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.847+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:21.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.847+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:58:21.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.887+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T14:58:21.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:58:21.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.903+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:58:21.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.911+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:58:21.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.915+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:58:21.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.931+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:58:21.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.963+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:58:22.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:21.995+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:22.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.027+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:58:22.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.055+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:58:22.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.059+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:58:22.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.095+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:58:22.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.131+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:58:22.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.151+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:58:22.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.163+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:58:22.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.171+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:22.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.175+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:58:22.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.175+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:58:22.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.219+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:58:22.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.219+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:58:22.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.239+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:58:22.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:58:22.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.251+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:22.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.267+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:58:22.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.279+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:58:22.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.287+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:58:22.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.307+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:58:22.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.323+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:58:22.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.327+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T14:58:22.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 84 15 918097 918082 683.037 692.688 0.00109092 0.00145418 2024-09-16T14:58:22.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.363+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:58:22.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:58:22.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.399+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:22.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.403+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:58:22.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.443+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:58:22.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.451+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:58:22.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.475+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:58:22.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.479+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:58:22.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.479+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:58:22.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.487+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T14:58:22.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.559+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:22.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.575+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:58:22.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.575+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:58:22.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.623+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T14:58:22.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.627+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T14:58:22.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.627+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T14:58:22.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.655+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:58:22.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.663+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:58:22.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.667+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:58:22.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:58:22.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.695+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:58:22.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.695+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:22.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.703+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:58:22.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.711+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:58:22.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.779+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:58:22.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.783+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:58:22.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.783+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:58:22.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.811+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:58:22.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.843+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:58:22.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.847+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:58:22.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.847+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:58:22.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.907+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:58:22.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.923+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T14:58:22.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.939+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:58:22.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.947+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:58:22.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.975+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:58:22.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.979+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:58:22.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:22.983+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:58:23.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.003+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:58:23.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.007+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:58:23.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.039+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:58:23.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.055+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:23.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.059+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:58:23.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.075+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:23.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.083+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:58:23.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:58:23.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.119+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:23.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.127+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:58:23.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.131+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:58:23.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.131+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:58:23.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.167+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:58:23.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.175+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:58:23.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:23.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:58:23.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.247+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:58:23.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.255+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:58:23.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.271+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:58:23.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.275+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:58:23.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.287+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:58:23.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.291+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:58:23.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.327+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:23.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.335+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:58:23.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.351+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:58:23.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 85 16 928924 928908 682.961 676.625 0.000689854 0.00145434 2024-09-16T14:58:23.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.383+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:23.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.387+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:23.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.403+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:58:23.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:58:23.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.435+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:58:23.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.447+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:58:23.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.467+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:58:23.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.471+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T14:58:23.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:58:23.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.483+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:23.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.487+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:58:23.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.531+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:58:23.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.535+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T14:58:23.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.543+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:58:23.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.583+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:58:23.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.583+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:58:23.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.607+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:58:23.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.631+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:58:23.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.635+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:58:23.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.651+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:58:23.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:58:23.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.659+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:58:23.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.663+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:58:23.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.695+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:58:23.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.695+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:58:23.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.715+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:58:23.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.723+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:58:23.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.743+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:58:23.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.755+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:58:23.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.783+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:58:23.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.803+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:58:23.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.807+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:58:23.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.819+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:58:23.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.823+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:58:23.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.863+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:58:23.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.887+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T14:58:23.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.895+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:58:23.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.903+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:58:23.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.911+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:58:23.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.931+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:58:23.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.939+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:58:23.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.943+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:58:23.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.955+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:58:23.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:23.971+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:58:24.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.023+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:58:24.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.031+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:58:24.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.035+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T14:58:24.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.059+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:58:24.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.063+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:58:24.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.091+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:24.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.099+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:58:24.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.111+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:58:24.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.127+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:24.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.147+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:58:24.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:58:24.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.167+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T14:58:24.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.195+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:58:24.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.199+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:58:24.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.199+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:24.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.215+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:58:24.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.231+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:58:24.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.247+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:58:24.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.271+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T14:58:24.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.275+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:24.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.279+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T14:58:24.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.291+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:58:24.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.295+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T14:58:24.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.311+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:24.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.347+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T14:58:24.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 86 16 940106 940090 683.146 698.875 0.00115391 0.00145398 2024-09-16T14:58:24.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.359+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:58:24.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.363+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:58:24.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.391+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:24.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.407+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:58:24.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.415+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:58:24.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:58:24.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.451+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T14:58:24.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.483+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:58:24.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.491+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:58:24.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.507+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T14:58:24.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:58:24.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.511+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:58:24.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.535+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:58:24.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.551+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T14:58:24.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.559+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:58:24.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.575+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:58:24.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.579+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:58:24.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.591+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:58:24.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.595+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:58:24.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.599+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:58:24.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:58:24.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.627+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:58:24.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.651+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:58:24.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.667+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:58:24.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.679+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:24.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.691+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:58:24.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.711+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:58:24.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.723+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:58:24.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:58:24.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.743+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:58:24.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:58:24.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.779+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:58:24.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.787+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:58:24.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.791+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:24.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.795+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:58:24.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.819+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:58:24.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.863+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:58:24.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.863+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:58:24.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.879+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:58:24.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.883+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:58:24.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.927+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:58:24.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.943+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:58:24.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.951+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:58:24.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.959+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:58:24.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.975+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:58:24.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:24.983+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:58:25.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.003+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:58:25.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.003+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:58:25.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.015+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:58:25.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.035+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:58:25.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.035+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:58:25.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.039+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:25.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.067+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:58:25.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.075+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:25.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.123+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:25.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.123+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:25.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.143+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:58:25.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.163+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:58:25.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.171+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:25.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.179+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:58:25.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.195+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:58:25.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.211+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:58:25.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.215+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:58:25.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:58:25.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.239+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:58:25.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.239+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:58:25.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.291+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:58:25.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.307+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:58:25.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.311+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T14:58:25.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.315+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:58:25.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.319+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:58:25.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.359+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:58:25.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.359+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:58:25.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 87 16 951069 951053 683.168 685.188 0.00184696 0.00145391 2024-09-16T14:58:25.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.399+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:25.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.411+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:58:25.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.431+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T14:58:25.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.439+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:58:25.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.447+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:58:25.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.455+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:58:25.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.475+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:58:25.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.487+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:58:25.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:58:25.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.511+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:25.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.511+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:58:25.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.523+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:25.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.523+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:58:25.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.539+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:58:25.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.543+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:58:25.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.555+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:58:25.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.555+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:58:25.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.559+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:58:25.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.563+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:58:25.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.591+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:58:25.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.599+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:58:25.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.615+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:58:25.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.619+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:58:25.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.631+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:58:25.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.639+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:58:25.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.655+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:58:25.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.675+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:58:25.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.699+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:58:25.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.735+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:58:25.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.739+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:58:25.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.763+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T14:58:25.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.775+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:58:25.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.775+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:58:25.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.783+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:58:25.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.799+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:58:25.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.827+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:58:25.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.827+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:58:25.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.843+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:58:25.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.847+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:58:25.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.855+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:58:25.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.887+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:58:25.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.895+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:58:25.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.899+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:25.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.899+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:58:25.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.911+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:58:25.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.951+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:58:25.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.951+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:58:25.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.963+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:58:25.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.967+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:58:25.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.987+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:58:26.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:25.999+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:58:26.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.019+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T14:58:26.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.023+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:58:26.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.055+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:58:26.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.071+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T14:58:26.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.079+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:58:26.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.083+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:58:26.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.083+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:58:26.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.107+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:58:26.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.131+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:58:26.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.135+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:58:26.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.163+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:58:26.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T14:58:26.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.179+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:58:26.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.179+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T14:58:26.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.207+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:58:26.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:58:26.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.223+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:58:26.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.227+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:26.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.247+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:58:26.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.271+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:58:26.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.275+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:58:26.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.283+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T14:58:26.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.327+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:58:26.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.327+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:58:26.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.335+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:58:26.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.351+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:58:26.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 88 15 961952 961937 683.135 680.25 0.000796443 0.00145399 2024-09-16T14:58:26.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.371+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:58:26.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.383+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:58:26.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.391+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:58:26.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.403+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:58:26.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.419+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:58:26.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.455+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:58:26.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.459+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:58:26.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.467+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:58:26.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.475+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:58:26.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.475+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:58:26.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.495+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:58:26.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.515+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:58:26.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.527+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:58:26.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.535+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:58:26.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.563+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:58:26.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:58:26.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.599+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:58:26.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.623+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:58:26.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.639+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:58:26.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.643+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:58:26.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.655+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:58:26.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.687+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:58:26.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.691+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:58:26.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.707+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:26.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.727+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:58:26.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.763+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:58:26.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.795+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:58:26.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.799+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:58:26.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.803+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:58:26.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.835+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:58:26.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.859+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:58:26.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:58:26.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:58:26.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.907+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:58:26.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.915+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:58:26.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.927+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T14:58:26.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.931+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:58:26.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.959+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T14:58:26.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:26.963+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:58:27.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.007+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:58:27.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.007+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:58:27.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.023+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:58:27.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.059+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T14:58:27.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.079+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:58:27.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.099+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:58:27.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.131+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:58:27.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.131+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:58:27.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.139+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:58:27.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.143+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:58:27.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.155+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:27.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.187+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:58:27.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.211+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:58:27.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.211+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T14:58:27.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.239+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:58:27.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:58:27.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.247+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:27.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.275+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:58:27.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.283+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:27.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.299+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:58:27.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.331+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T14:58:27.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.331+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:58:27.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.351+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:58:27.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.351+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:58:27.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 89 16 973393 973377 683.492 715 0.000558507 0.00145323 2024-09-16T14:58:27.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.363+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:58:27.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.403+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:27.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.407+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:58:27.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.431+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:58:27.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.463+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:58:27.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.471+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:58:27.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.515+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:58:27.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.531+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:58:27.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.535+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:58:27.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.535+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:58:27.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.547+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:58:27.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.575+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:58:27.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.583+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:58:27.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.583+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:58:27.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.587+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:58:27.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.623+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:58:27.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.627+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:58:27.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.643+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:27.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.671+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:58:27.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.675+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:58:27.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.687+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:58:27.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.743+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:58:27.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.747+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:58:27.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.751+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:58:27.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.759+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:58:27.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.763+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:58:27.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.791+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:58:27.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.795+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:58:27.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.815+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:58:27.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.827+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:58:27.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:58:27.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:58:27.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.855+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:58:27.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.863+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:58:27.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.863+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:58:27.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.867+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:58:27.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.915+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:58:27.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.927+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:58:27.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.935+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:58:27.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.935+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:58:27.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.975+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:58:27.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.979+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:58:27.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:27.987+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:58:28.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.011+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:58:28.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.027+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:58:28.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.031+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:58:28.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.039+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:58:28.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.075+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T14:58:28.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.091+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:58:28.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.091+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:58:28.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.107+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:58:28.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.111+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:58:28.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:58:28.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.139+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:58:28.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.183+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:58:28.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.199+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:58:28.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:58:28.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.203+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:58:28.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.211+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:58:28.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.215+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:28.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.235+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:58:28.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:58:28.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.255+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:58:28.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.259+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:58:28.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.259+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:58:28.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.291+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T14:58:28.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.295+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:58:28.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.307+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:58:28.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.323+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:58:28.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.343+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:58:28.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.343+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T14:58:28.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.347+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:58:28.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 90 15 984204 984189 683.405 675.75 0.00129018 0.00145337 2024-09-16T14:58:28.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:58:28.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.399+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:58:28.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.399+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:58:28.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.447+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:58:28.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.451+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:58:28.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.463+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:58:28.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.483+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:58:28.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.503+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:58:28.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.503+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T14:58:28.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.507+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:58:28.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.507+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:58:28.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.515+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:58:28.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.543+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:28.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.555+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:58:28.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.571+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:58:28.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.575+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:58:28.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.591+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:58:28.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.595+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:58:28.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.607+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:58:28.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.607+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:58:28.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.663+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:58:28.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:58:28.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.675+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:58:28.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.687+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:58:28.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.691+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:58:28.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.711+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:58:28.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.727+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T14:58:28.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.731+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:58:28.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.743+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:58:28.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.759+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:58:28.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.783+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T14:58:28.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.783+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:58:28.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.815+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:58:28.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.835+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:58:28.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.843+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:58:28.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.855+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:58:28.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.871+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:58:28.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.895+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:58:28.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.903+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:58:28.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:58:28.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.919+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:58:28.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.935+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:58:28.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.947+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:58:28.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.951+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:58:28.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.983+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:58:28.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:28.987+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:58:29.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.007+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:58:29.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.035+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:58:29.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.043+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:58:29.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.047+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:58:29.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.059+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:58:29.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.091+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:58:29.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.111+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T14:58:29.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.127+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:58:29.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.127+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T14:58:29.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.131+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:58:29.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.147+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:58:29.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.147+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:29.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.151+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:58:29.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.179+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:58:29.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.195+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:58:29.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.219+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:58:29.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:29.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.263+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:58:29.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.263+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:58:29.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.279+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:58:29.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.299+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:58:29.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.299+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:58:29.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.307+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:58:29.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.315+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:58:29.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.327+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:58:29.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.327+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:58:29.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.335+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:58:29.363 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 91 15 995084 995069 683.367 680 0.00109819 0.00145344 2024-09-16T14:58:29.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.371+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:58:29.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.387+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:58:29.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.411+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:58:29.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.423+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:29.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.443+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:58:29.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.447+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T14:58:29.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.455+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:58:29.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.459+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:58:29.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.491+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:58:29.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:58:29.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.499+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:58:29.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:58:29.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.531+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:58:29.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.535+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:58:29.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.559+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:58:29.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.563+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:58:29.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.567+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:58:29.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.591+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:58:29.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.595+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:58:29.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.615+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:58:29.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.639+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:58:29.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.675+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:58:29.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.699+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:58:29.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.703+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:58:29.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.715+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:58:29.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.739+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:58:29.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.751+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:58:29.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.755+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:58:29.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.767+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:58:29.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.775+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:58:29.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.783+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:58:29.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.799+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:58:29.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.811+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:58:29.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.827+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:58:29.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.831+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:58:29.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.831+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T14:58:29.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.851+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:58:29.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.875+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:58:29.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.887+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:58:29.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.903+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:58:29.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.907+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:58:29.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.923+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:58:29.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.927+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:29.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:29.979+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:58:30.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.007+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:58:30.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.043+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:30.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.047+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:58:30.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.063+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:58:30.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.067+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:58:30.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.095+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:58:30.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.099+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:58:30.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.111+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:58:30.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.119+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:58:30.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.139+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:58:30.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.159+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:58:30.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.175+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:30.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.183+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:58:30.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.199+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:58:30.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.207+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:58:30.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.219+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:58:30.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:58:30.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.247+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:58:30.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.267+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:58:30.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.275+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:58:30.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.279+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:58:30.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.287+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:58:30.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:58:30.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.319+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:58:30.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.347+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:58:30.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.351+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T14:58:30.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.351+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:58:30.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.359+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:58:30.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 92 16 1006397 1006381 683.624 707 0.000629899 0.00145294 2024-09-16T14:58:30.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.403+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:58:30.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.415+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:58:30.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.431+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:30.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.451+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:58:30.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.507+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:58:30.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.507+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:58:30.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.511+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:58:30.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.515+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:58:30.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.531+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:58:30.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.539+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:30.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.555+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T14:58:30.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:58:30.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.575+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:58:30.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.579+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:30.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.619+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:58:30.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.643+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:58:30.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.647+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:58:30.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.671+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:58:30.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.683+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:58:30.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.695+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:58:30.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.719+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T14:58:30.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.735+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:58:30.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.759+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:58:30.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:58:30.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:58:30.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.799+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T14:58:30.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.815+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:58:30.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.823+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:58:30.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.863+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:58:30.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.883+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:58:30.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:58:30.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.907+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:58:30.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.935+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:58:30.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.955+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:58:30.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.963+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:58:30.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.983+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:58:31.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:30.999+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:58:31.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.015+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:31.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.019+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:58:31.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.035+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:58:31.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.051+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T14:58:31.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.055+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:58:31.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.067+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:58:31.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.083+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:31.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.087+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:58:31.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.099+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:58:31.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.115+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:58:31.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.115+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:58:31.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.119+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:58:31.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.127+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:58:31.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.147+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:58:31.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.159+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T14:58:31.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.199+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:58:31.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:58:31.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.219+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:58:31.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.219+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:58:31.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.227+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:58:31.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.255+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:58:31.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.259+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:58:31.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.275+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:58:31.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.283+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:58:31.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.287+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:58:31.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.319+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:58:31.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:58:31.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.347+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:58:31.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 93 16 1017623 1017607 683.817 701.625 0.00449487 0.00145255 2024-09-16T14:58:31.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.363+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:31.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.387+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T14:58:31.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.391+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T14:58:31.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.399+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:58:31.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.403+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:58:31.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.455+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:58:31.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.455+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:58:31.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.467+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:58:31.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.487+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:58:31.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.495+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T14:58:31.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.503+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:58:31.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.531+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:58:31.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.551+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:58:31.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.555+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:31.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.583+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:58:31.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.603+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:58:31.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.607+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T14:58:31.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.627+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:58:31.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.635+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:58:31.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.647+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:58:31.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.659+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T14:58:31.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.663+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:58:31.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:58:31.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.683+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T14:58:31.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.699+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:31.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.707+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:58:31.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.707+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:58:31.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.727+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:58:31.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.739+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:58:31.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.739+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:58:31.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.791+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:31.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.799+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:58:31.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.799+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:58:31.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.827+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T14:58:31.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:58:31.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.863+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:58:31.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.875+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:58:31.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.875+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T14:58:31.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.879+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:58:31.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.887+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:58:31.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.899+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:58:31.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.931+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:58:31.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.959+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:58:31.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.963+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:58:31.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.979+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:58:31.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:31.979+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:32.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.007+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:58:32.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.011+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:58:32.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.059+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T14:58:32.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.079+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:58:32.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.079+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:58:32.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.091+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:58:32.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.103+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:58:32.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.135+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:58:32.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:58:32.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.139+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:58:32.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.159+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:58:32.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.179+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:58:32.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.187+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:58:32.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.195+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:58:32.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.199+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:58:32.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.227+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:58:32.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.227+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:32.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T14:58:32.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.247+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:58:32.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.275+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:58:32.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.279+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:32.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.287+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:58:32.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.291+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:58:32.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.307+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:58:32.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.343+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T14:58:32.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.347+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:58:32.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 94 16 1028657 1028641 683.878 689.625 0.00390947 0.00145241 2024-09-16T14:58:32.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.363+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T14:58:32.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.375+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:58:32.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.387+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:58:32.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.395+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:58:32.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.403+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T14:58:32.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.427+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:58:32.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.439+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:58:32.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.447+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:58:32.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.463+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T14:58:32.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.471+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:58:32.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.471+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:58:32.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.499+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:58:32.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.515+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:58:32.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.523+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T14:58:32.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.563+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:58:32.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.567+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:58:32.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:32.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.583+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:58:32.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.607+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:58:32.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.611+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:58:32.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.631+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:58:32.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.635+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:58:32.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:58:32.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.671+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:58:32.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.675+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:58:32.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.683+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:58:32.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.683+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:58:32.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.691+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:32.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.719+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:58:32.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.747+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:58:32.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.759+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:58:32.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.759+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:58:32.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.795+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T14:58:32.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.803+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:58:32.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.811+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:58:32.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.815+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:32.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.847+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:58:32.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.855+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:58:32.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.863+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T14:58:32.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.875+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:58:32.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.891+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:58:32.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.935+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:58:32.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.939+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:58:32.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.967+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:58:32.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.995+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:58:33.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:32.999+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:33.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.015+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:58:33.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.019+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:58:33.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.027+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:58:33.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.035+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:58:33.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.071+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:58:33.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.091+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T14:58:33.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.099+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:58:33.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.107+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:58:33.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.119+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T14:58:33.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.123+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:58:33.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.163+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:58:33.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.167+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:58:33.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.175+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:58:33.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.187+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T14:58:33.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.195+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:58:33.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.203+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T14:58:33.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T14:58:33.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.239+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:58:33.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.247+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:58:33.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.283+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:58:33.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:58:33.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.307+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T14:58:33.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.311+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:58:33.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.331+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:58:33.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.339+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T14:58:33.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 95 16 1039783 1039767 683.998 695.375 0.00109408 0.00145214 2024-09-16T14:58:33.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.363+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T14:58:33.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.383+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:58:33.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.387+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T14:58:33.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.403+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:58:33.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.419+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:58:33.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.443+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:58:33.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.443+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:58:33.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.447+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:58:33.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.463+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:58:33.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.491+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:58:33.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:58:33.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.511+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:58:33.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.531+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:58:33.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.535+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:58:33.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.547+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:58:33.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.575+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:58:33.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.579+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:58:33.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.579+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T14:58:33.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.603+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:33.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.611+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:58:33.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.627+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:58:33.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.647+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:58:33.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.651+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:33.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.651+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:58:33.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.655+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:58:33.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.687+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:58:33.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.691+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:33.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.695+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:33.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.699+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T14:58:33.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.715+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:58:33.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.719+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:58:33.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.743+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:58:33.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.767+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:58:33.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:58:33.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.799+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:58:33.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.799+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:58:33.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.811+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:58:33.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:58:33.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:58:33.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.863+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:58:33.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.867+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:58:33.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.883+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:58:33.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.883+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:58:33.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.895+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:58:33.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.907+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:58:33.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.911+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:58:33.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.923+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:58:33.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.923+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:58:33.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.939+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:58:33.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:33.967+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:58:34.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.011+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:58:34.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.023+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:58:34.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.055+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:58:34.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.083+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:58:34.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.087+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:58:34.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.111+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:58:34.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.119+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:58:34.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.143+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:58:34.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.155+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:58:34.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.163+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:58:34.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.179+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:58:34.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:58:34.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.223+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:58:34.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.227+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:58:34.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.227+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T14:58:34.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.231+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:58:34.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.279+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T14:58:34.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.303+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:58:34.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.319+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:58:34.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.323+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T14:58:34.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.327+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T14:58:34.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.347+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:58:34.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.351+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:34.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 96 16 1050675 1050659 683.964 680.75 0.000755772 0.0014522 2024-09-16T14:58:34.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.379+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:58:34.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.391+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:58:34.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.395+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:58:34.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:58:34.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.427+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:58:34.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.455+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T14:58:34.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.455+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:58:34.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.459+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:34.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.471+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:58:34.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.491+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:34.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:58:34.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.511+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:58:34.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.515+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T14:58:34.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.551+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:34.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.567+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:58:34.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.567+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:58:34.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:58:34.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.591+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:58:34.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.615+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:58:34.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.615+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:58:34.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.623+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:58:34.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.643+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:58:34.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.651+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:58:34.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.671+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:58:34.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.687+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:58:34.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.691+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:58:34.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.703+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:58:34.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.719+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:58:34.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.727+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:58:34.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.735+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:58:34.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.735+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:58:34.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.771+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:58:34.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.787+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:58:34.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.795+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:58:34.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.803+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:58:34.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.815+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:58:34.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.819+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:58:34.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.835+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:58:34.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.851+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:34.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.875+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:58:34.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.891+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:58:34.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.915+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:58:34.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.935+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:58:34.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.939+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:58:34.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.955+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:58:34.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.963+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:58:34.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.967+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:58:34.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:34.979+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:58:35.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.007+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T14:58:35.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.015+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T14:58:35.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:58:35.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.051+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:58:35.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.059+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:58:35.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.083+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T14:58:35.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T14:58:35.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.103+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:35.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.111+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:58:35.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.127+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:35.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:58:35.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.147+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:58:35.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.151+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:58:35.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.167+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:58:35.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:58:35.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.203+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:58:35.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.219+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:58:35.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.235+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:58:35.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.239+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:58:35.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:35.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.259+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:58:35.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.267+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:58:35.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.291+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:58:35.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:58:35.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.319+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:58:35.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.347+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:58:35.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.351+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:58:35.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 97 16 1061700 1061684 684.016 689.062 0.000960113 0.00145212 2024-09-16T14:58:35.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.359+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:58:35.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.387+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:58:35.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.387+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:58:35.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.423+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:58:35.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.435+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:58:35.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.439+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:58:35.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.443+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:35.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.455+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:58:35.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.467+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:58:35.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:35.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.503+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:58:35.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.527+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:58:35.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.543+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:58:35.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.555+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:35.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.563+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:58:35.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.571+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:58:35.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.591+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:58:35.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.611+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:58:35.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.611+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T14:58:35.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.615+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:58:35.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.619+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:58:35.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.623+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:58:35.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.651+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:58:35.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.691+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:58:35.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:58:35.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.699+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:58:35.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.719+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:58:35.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.723+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T14:58:35.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.759+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:58:35.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.767+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:58:35.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:35.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.811+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:58:35.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.831+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:58:35.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.831+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:58:35.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.855+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:58:35.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.879+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:58:35.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.883+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:35.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T14:58:35.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.899+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:58:35.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.899+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:58:35.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.955+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:58:35.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.955+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:58:35.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.959+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:58:35.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.979+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:58:35.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:35.979+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:58:36.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.003+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:58:36.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.007+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:58:36.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.007+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:58:36.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.035+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:58:36.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.043+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:58:36.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.067+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:58:36.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.095+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:58:36.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.107+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:36.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.115+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:58:36.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.115+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:58:36.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.139+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:58:36.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.147+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:36.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.171+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:58:36.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:58:36.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.207+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:58:36.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.211+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:58:36.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.239+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:58:36.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.239+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:58:36.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.243+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:58:36.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.263+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:36.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.291+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:58:36.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.295+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:58:36.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.323+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:58:36.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.327+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:58:36.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.351+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:58:36.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 98 15 1072953 1072938 684.212 703.375 0.00134678 0.00145171 2024-09-16T14:58:36.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.363+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:58:36.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.395+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:58:36.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.399+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:58:36.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.407+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:58:36.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.411+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:58:36.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.419+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T14:58:36.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.443+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T14:58:36.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.459+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:58:36.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.467+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:58:36.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.475+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:58:36.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.479+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:58:36.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:36.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:58:36.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:58:36.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.527+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T14:58:36.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.543+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T14:58:36.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.543+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:58:36.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.583+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:58:36.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.587+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:58:36.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.599+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:58:36.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.607+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:36.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.631+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:58:36.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.635+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:58:36.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.655+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T14:58:36.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.655+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:58:36.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.659+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:58:36.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.683+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T14:58:36.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.711+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:36.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.719+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T14:58:36.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.723+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:58:36.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.731+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:58:36.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.751+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:58:36.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.751+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:58:36.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.767+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:58:36.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.783+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:58:36.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.787+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:36.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.791+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:58:36.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.811+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:58:36.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.819+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:58:36.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.871+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:58:36.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.887+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:58:36.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.903+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:58:36.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.919+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:58:36.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:58:36.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.927+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:58:36.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.939+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:36.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.963+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:58:36.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.967+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:58:37.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:36.999+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:58:37.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.023+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:37.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.027+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:58:37.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.043+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:37.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.047+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:58:37.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.059+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:58:37.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.067+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:58:37.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.083+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T14:58:37.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.107+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T14:58:37.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.119+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:58:37.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.119+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:58:37.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.167+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:58:37.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.171+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:58:37.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.183+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:58:37.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.191+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:58:37.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.195+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:58:37.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.211+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:58:37.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.231+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:58:37.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.243+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:58:37.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.247+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:58:37.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.247+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:58:37.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.271+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:58:37.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.287+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:58:37.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.311+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:58:37.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.351+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:58:37.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 99 16 1084102 1084086 684.339 696.75 0.000760772 0.00145145 2024-09-16T14:58:37.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.359+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:58:37.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.367+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:58:37.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.383+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:58:37.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.403+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T14:58:37.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.439+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:58:37.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.459+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:58:37.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.467+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:58:37.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.475+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T14:58:37.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.495+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:58:37.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:58:37.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.507+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:58:37.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.519+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:58:37.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.547+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:58:37.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.555+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:58:37.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.583+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:37.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.607+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:58:37.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.607+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:58:37.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.611+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:58:37.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.615+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:58:37.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.623+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T14:58:37.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.639+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:58:37.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.639+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:58:37.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.679+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:37.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.695+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:58:37.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.699+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:58:37.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.727+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:37.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.735+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:58:37.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.771+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:58:37.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.775+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:58:37.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.791+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:58:37.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.803+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:58:37.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.815+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:58:37.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.827+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:58:37.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.855+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:58:37.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.859+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:37.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.883+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:58:37.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.891+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:58:37.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.891+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:58:37.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.911+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:58:37.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.927+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:37.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.931+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:58:37.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.951+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:58:37.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.959+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:58:37.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.983+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:58:38.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:37.999+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:58:38.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.007+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T14:58:38.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.011+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:58:38.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.015+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:58:38.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.019+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T14:58:38.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.023+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:58:38.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.043+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:58:38.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.063+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:58:38.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.079+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:58:38.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.083+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:58:38.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.103+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:58:38.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.127+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:38.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:58:38.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.143+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:58:38.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.163+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:58:38.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.171+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:58:38.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.175+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:58:38.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.175+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:58:38.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.187+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:58:38.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.203+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:58:38.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.251+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:58:38.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.263+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:38.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.283+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:58:38.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:58:38.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:58:38.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.311+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:58:38.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.335+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:58:38.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.339+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:58:38.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:58:38.364183+0000 min lat: 0.000220975 max lat: 0.121854 avg lat: 0.00145121 2024-09-16T14:58:38.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:58:38.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 100 16 1095218 1095202 684.442 694.75 0.00115321 0.00145121 2024-09-16T14:58:38.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.363+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:58:38.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.367+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:58:38.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.395+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:58:38.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.399+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:58:38.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.407+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:58:38.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.443+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:58:38.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.451+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:58:38.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.451+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:58:38.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.459+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:58:38.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.463+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:58:38.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:58:38.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.499+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:58:38.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.511+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:58:38.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.523+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:58:38.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.547+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:58:38.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.547+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:58:38.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.583+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:58:38.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.591+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:58:38.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.595+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:58:38.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.643+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:58:38.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.647+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:58:38.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.647+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:58:38.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.651+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:58:38.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:58:38.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.683+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:58:38.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.691+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:58:38.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.707+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:58:38.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.707+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:38.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.719+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:58:38.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.759+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T14:58:38.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.775+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:58:38.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.787+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T14:58:38.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.787+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:58:38.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.799+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:58:38.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.811+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:58:38.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.831+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:58:38.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.831+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:58:38.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.847+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:58:38.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.867+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:58:38.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.871+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:58:38.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.903+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:58:38.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.915+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:58:38.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.919+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:58:38.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.951+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:58:38.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.959+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:58:38.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.959+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:58:38.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.971+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:38.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.979+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:58:38.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:38.979+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:58:39.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.015+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:58:39.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.059+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:58:39.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.087+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:58:39.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.087+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:58:39.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.091+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:39.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.111+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:58:39.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.119+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:58:39.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.119+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:58:39.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.119+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:58:39.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.175+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:58:39.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.187+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:58:39.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.199+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:39.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.219+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:58:39.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.223+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:58:39.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.247+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:39.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:58:39.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.263+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:39.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.271+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:58:39.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.279+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:58:39.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.307+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:58:39.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.319+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:58:39.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.323+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T14:58:39.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.331+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:58:39.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.331+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:58:39.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 101 16 1106153 1106137 684.432 683.438 0.00060288 0.00145118 2024-09-16T14:58:39.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.367+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:39.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.383+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:58:39.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.391+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:58:39.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:58:39.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.399+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T14:58:39.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.403+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:39.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.423+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:58:39.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.527+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:58:39.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.591+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:58:39.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.607+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.615+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.639+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.647+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.659+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.703+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.723+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.723+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.723+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.747+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.759+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:58:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.759+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.763+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.775+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.791+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.795+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.795+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.851+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.875+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.879+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.883+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.903+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.927+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.947+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:58:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.963+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:58:39.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.971+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:58:39.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.975+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:58:39.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:39.983+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:58:40.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.003+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:58:40.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.011+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T14:58:40.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.019+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:58:40.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.031+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:58:40.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.035+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:58:40.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.059+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:58:40.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.063+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:58:40.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.115+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:58:40.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.119+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:58:40.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.143+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:58:40.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.159+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:58:40.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.183+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T14:58:40.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.195+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:58:40.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.223+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:58:40.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.227+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:58:40.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.231+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:58:40.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.271+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T14:58:40.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.279+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:58:40.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.295+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T14:58:40.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.311+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:58:40.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.319+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:58:40.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.335+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:40.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 102 16 1115563 1115547 683.487 588.125 0.00104018 0.00145322 2024-09-16T14:58:40.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.363+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:40.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.375+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:58:40.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.391+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:58:40.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.403+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:58:40.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.435+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:58:40.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.455+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:58:40.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.471+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:58:40.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.487+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:58:40.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.487+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:58:40.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.511+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T14:58:40.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.555+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:58:40.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.571+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:58:40.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.575+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T14:58:40.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.599+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:58:40.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:58:40.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.607+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T14:58:40.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.611+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:58:40.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.627+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:58:40.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.651+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:58:40.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.679+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:58:40.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.683+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T14:58:40.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.687+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:58:40.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.703+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:58:40.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.723+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T14:58:40.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.723+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:58:40.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:58:40.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.763+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:58:40.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.771+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:58:40.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.775+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:58:40.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.795+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:58:40.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.807+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:58:40.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.831+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:58:40.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.839+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:58:40.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.855+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:58:40.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.871+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:58:40.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.895+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:58:40.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:58:40.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.911+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T14:58:40.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.927+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:58:40.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.927+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:40.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.943+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:58:40.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.955+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:58:41.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:40.999+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:58:41.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.039+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:58:41.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.075+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:58:41.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.087+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:58:41.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:58:41.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.155+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:58:41.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.179+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:41.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.183+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:41.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.187+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:58:41.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.215+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:58:41.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.223+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:58:41.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.231+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:58:41.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.287+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:58:41.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.299+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T14:58:41.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.303+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:58:41.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.319+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:58:41.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.327+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:58:41.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.347+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:58:41.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.351+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:58:41.364 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 103 16 1126564 1126548 683.526 687.562 0.00299762 0.00145317 2024-09-16T14:58:41.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.367+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:58:41.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.371+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:58:41.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.399+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:41.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.431+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:58:41.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.443+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:58:41.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.451+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:58:41.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.483+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:58:41.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.483+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T14:58:41.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.503+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:58:41.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.531+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:58:41.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.539+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:58:41.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.551+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:58:41.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.563+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:58:41.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.595+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T14:58:41.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.595+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:58:41.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.607+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:41.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.615+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:58:41.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.627+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:58:41.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.639+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:58:41.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.643+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:58:41.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.647+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:58:41.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.647+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:58:41.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:58:41.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.687+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T14:58:41.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.711+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:58:41.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.731+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T14:58:41.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.735+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:58:41.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.755+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T14:58:41.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.775+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T14:58:41.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.783+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:58:41.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.807+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:58:41.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.827+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:58:41.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.843+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:58:41.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.859+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:58:41.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.879+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:58:41.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.891+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:58:41.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.927+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:41.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.935+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:58:41.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.943+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:58:41.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.983+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:58:41.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:41.987+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:42.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:58:42.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.023+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T14:58:42.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.027+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T14:58:42.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.043+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:58:42.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.047+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:58:42.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.083+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:58:42.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.091+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:58:42.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.091+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:42.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.091+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:58:42.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.111+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:58:42.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.115+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:58:42.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.143+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:58:42.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.143+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:58:42.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.171+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T14:58:42.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.199+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:58:42.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.199+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:58:42.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.211+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:58:42.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.215+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:58:42.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.227+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:58:42.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.239+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:58:42.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.251+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:58:42.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.263+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:42.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.271+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:42.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.287+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:58:42.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.291+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:58:42.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.323+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:58:42.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.339+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:58:42.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.343+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:58:42.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 104 16 1137648 1137632 683.614 692.75 0.00146362 0.00145296 2024-09-16T14:58:42.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.359+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:58:42.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.371+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:58:42.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.371+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:58:42.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.403+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:58:42.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.419+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:58:42.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.419+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:58:42.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.435+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:58:42.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.439+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:58:42.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.451+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:58:42.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.491+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:58:42.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.499+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:58:42.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.499+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:58:42.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.543+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:58:42.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.563+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:58:42.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.579+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:58:42.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.583+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:58:42.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.591+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:58:42.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.607+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:58:42.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.631+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:58:42.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.635+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:58:42.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.671+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:58:42.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.679+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:58:42.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.683+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:58:42.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.687+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:58:42.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.691+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:58:42.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.715+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T14:58:42.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.715+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:58:42.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.727+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:42.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.787+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:58:42.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.799+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T14:58:42.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.811+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:58:42.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.819+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:58:42.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.827+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:58:42.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.855+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:58:42.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.883+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:58:42.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.891+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:58:42.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.911+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:58:42.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.943+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T14:58:42.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.955+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:58:42.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:42.959+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:58:43.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.007+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:58:43.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.031+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:58:43.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.055+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:58:43.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.055+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:58:43.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.067+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T14:58:43.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:58:43.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.135+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:58:43.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.151+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:58:43.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.171+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:43.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:58:43.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.187+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:58:43.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.219+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T14:58:43.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.231+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:58:43.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.243+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:58:43.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.247+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:58:43.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.271+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:58:43.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.279+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:58:43.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.287+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:58:43.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.295+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:58:43.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.299+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T14:58:43.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.303+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:43.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.327+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:58:43.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.355+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:58:43.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 105 16 1148910 1148894 683.806 703.875 0.00070546 0.00145253 2024-09-16T14:58:43.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.367+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:58:43.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:58:43.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.383+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:58:43.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.383+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T14:58:43.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.391+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:58:43.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.403+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:58:43.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.447+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:58:43.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.467+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:58:43.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.467+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:43.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.471+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:58:43.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.483+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:58:43.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.495+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:58:43.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.507+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:58:43.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.523+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T14:58:43.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.535+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:58:43.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.535+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:58:43.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.555+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:58:43.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.567+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:58:43.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.591+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:43.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.595+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:58:43.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.607+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:58:43.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.619+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:58:43.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.623+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:58:43.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.627+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:58:43.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.643+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:58:43.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.651+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:58:43.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.679+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T14:58:43.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.687+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:58:43.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.695+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:58:43.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.699+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:43.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.731+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:58:43.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.743+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:58:43.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.743+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:58:43.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.759+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:58:43.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.775+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:58:43.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.779+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:58:43.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.787+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:58:43.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.819+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:58:43.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:58:43.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.819+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:58:43.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.843+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:58:43.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.847+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:58:43.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.859+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:43.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.875+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T14:58:43.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.879+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:43.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.887+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T14:58:43.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.899+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:58:43.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.931+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:58:43.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.947+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:58:43.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.971+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:58:43.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:43.995+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:58:44.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.007+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:58:44.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.039+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:58:44.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.051+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:44.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.055+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T14:58:44.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.071+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:58:44.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.091+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T14:58:44.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.111+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:58:44.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.111+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:58:44.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.111+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:58:44.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.147+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:44.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.179+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:44.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.191+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:58:44.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.195+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:58:44.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:58:44.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.223+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:58:44.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:44.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.279+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:58:44.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.279+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:58:44.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.295+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:58:44.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.311+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:58:44.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.331+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:58:44.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.339+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:58:44.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.347+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:58:44.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.359+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:58:44.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 106 16 1159780 1159764 683.764 679.375 0.00124865 0.00145265 2024-09-16T14:58:44.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.367+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:58:44.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.379+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:58:44.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.399+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:58:44.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.403+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:58:44.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.415+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:58:44.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.479+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:58:44.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.491+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:58:44.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.495+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:58:44.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.531+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:58:44.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.535+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:58:44.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.551+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:58:44.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.563+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:58:44.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.563+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:58:44.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.587+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:58:44.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.587+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:58:44.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.591+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:58:44.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.615+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:58:44.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.635+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:44.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.663+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:58:44.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.663+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:58:44.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.679+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T14:58:44.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.687+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:58:44.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.707+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:58:44.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.715+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:58:44.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.719+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:58:44.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.735+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:58:44.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.763+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:58:44.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.775+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:58:44.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.783+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:58:44.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.787+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T14:58:44.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:58:44.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.819+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:58:44.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:58:44.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.859+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:58:44.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.867+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:58:44.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.879+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:58:44.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.891+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:58:44.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.895+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:58:44.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.895+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:58:44.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.903+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:58:44.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.943+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:58:44.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:44.955+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:58:45.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.018+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:58:45.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.030+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T14:58:45.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.042+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:58:45.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.046+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:58:45.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.058+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:58:45.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.090+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:58:45.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.094+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:58:45.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.106+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:58:45.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.110+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T14:58:45.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.150+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:58:45.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T14:58:45.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.170+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:58:45.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.174+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:58:45.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.178+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:58:45.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.178+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:58:45.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.198+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:58:45.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.234+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:45.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.238+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:58:45.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.266+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:58:45.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.286+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:58:45.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.290+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:45.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.298+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:58:45.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:58:45.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.318+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:58:45.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.338+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T14:58:45.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.342+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:58:45.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.346+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:58:45.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 107 16 1169860 1169844 683.261 630 0.000882975 0.0014537 2024-09-16T14:58:45.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.370+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:58:45.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.382+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:58:45.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.382+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T14:58:45.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T14:58:45.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.410+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:58:45.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.422+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:58:45.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.430+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:58:45.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.442+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:58:45.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:58:45.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.494+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:58:45.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.498+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:58:45.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.514+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:58:45.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.522+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:58:45.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:58:45.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.538+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:58:45.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.550+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:58:45.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.554+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T14:58:45.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.582+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:58:45.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.582+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:58:45.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.618+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:58:45.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.634+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T14:58:45.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.646+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:58:45.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.682+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:58:45.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.690+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:58:45.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.718+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:58:45.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.722+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:58:45.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.750+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:58:45.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.758+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:58:45.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.758+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:58:45.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.806+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:58:45.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.830+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:58:45.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.854+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T14:58:45.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.858+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T14:58:45.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.890+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:58:45.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.898+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:58:45.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.902+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T14:58:45.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.910+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:58:45.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.942+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:58:45.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.942+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:58:45.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.962+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:58:46.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:45.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:46.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.046+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:58:46.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.054+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:58:46.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.054+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:58:46.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.106+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:46.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.114+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:58:46.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.114+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:58:46.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.146+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:58:46.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.150+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:58:46.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.170+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:58:46.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.190+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:58:46.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.198+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T14:58:46.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.218+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:58:46.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.222+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:58:46.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.258+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:58:46.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.270+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:58:46.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.286+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:58:46.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.298+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T14:58:46.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.302+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:58:46.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.306+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:58:46.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.314+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:58:46.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.326+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T14:58:46.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.342+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:58:46.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.342+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:58:46.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 108 16 1180571 1180555 683.133 669.438 0.000729856 0.00145395 2024-09-16T14:58:46.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.382+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:46.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.394+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:58:46.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.406+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:58:46.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.406+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:46.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.434+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:46.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.442+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T14:58:46.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.462+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:58:46.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.466+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:58:46.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.474+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T14:58:46.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.486+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:46.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.510+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:58:46.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.510+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:58:46.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.542+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:58:46.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.558+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:58:46.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.566+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:58:46.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.570+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:58:46.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.586+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:58:46.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.626+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T14:58:46.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.642+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:58:46.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.646+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:58:46.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.666+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:58:46.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.682+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:58:46.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.686+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:58:46.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.698+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:46.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.718+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:58:46.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.726+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:58:46.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.730+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:58:46.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.746+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:58:46.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.770+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T14:58:46.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.774+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:58:46.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.786+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:58:46.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:46.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.806+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:58:46.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.834+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:58:46.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.854+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:58:46.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.862+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T14:58:46.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.878+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T14:58:46.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.886+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:58:46.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.894+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:58:46.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.918+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:46.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.950+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:58:46.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.970+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:58:46.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.982+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:58:46.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.986+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T14:58:46.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.986+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:46.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:46.986+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:47.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.018+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T14:58:47.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.058+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:58:47.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.070+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:58:47.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.086+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T14:58:47.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.094+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:58:47.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.110+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:58:47.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.130+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:58:47.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.134+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:47.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.146+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:58:47.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.158+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:58:47.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.178+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:47.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.194+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:47.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.194+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:58:47.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.226+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:58:47.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.234+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:58:47.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.250+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:58:47.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.258+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:58:47.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.274+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T14:58:47.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.274+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:47.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.278+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:58:47.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.322+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:47.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.334+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:58:47.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.342+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:58:47.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 109 16 1191668 1191652 683.228 693.562 0.00124439 0.00145377 2024-09-16T14:58:47.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.382+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:58:47.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.386+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:58:47.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.390+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:47.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.430+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:58:47.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:58:47.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.438+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:58:47.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.442+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:58:47.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.490+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:58:47.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.498+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:58:47.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.518+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:58:47.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.518+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:58:47.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.526+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:58:47.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.538+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:58:47.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.542+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:58:47.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.562+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:58:47.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.570+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:58:47.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.574+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:58:47.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.618+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:47.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.626+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:58:47.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.634+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:58:47.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.646+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T14:58:47.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.666+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:58:47.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.674+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:58:47.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.686+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:58:47.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.702+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:58:47.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.718+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:58:47.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.754+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:58:47.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.758+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:58:47.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.762+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:58:47.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.774+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:47.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.794+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:58:47.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.814+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:47.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.822+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:58:47.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:58:47.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.830+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:58:47.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.862+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:58:47.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.898+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:58:47.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.918+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:58:47.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.926+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:58:47.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.934+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:58:47.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.962+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:58:47.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:47.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:58:48.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.002+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:48.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:58:48.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.010+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:58:48.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.030+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:58:48.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.070+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:58:48.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.082+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:58:48.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.094+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:58:48.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.110+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T14:58:48.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.118+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:58:48.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.142+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:58:48.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.142+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:58:48.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.146+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:58:48.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:58:48.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.162+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:58:48.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.178+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:58:48.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.178+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:58:48.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.202+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T14:58:48.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.258+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:58:48.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.306+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:58:48.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.326+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:58:48.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 110 16 1202949 1202933 683.425 705.062 0.00147045 0.00145339 2024-09-16T14:58:48.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.370+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:58:48.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.370+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:58:48.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.378+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:58:48.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.418+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:58:48.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.434+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:58:48.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.438+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:58:48.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:58:48.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.478+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:58:48.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.478+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T14:58:48.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.482+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T14:58:48.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.494+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:58:48.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.510+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:58:48.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:58:48.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.570+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:58:48.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.570+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:48.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.606+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:58:48.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.634+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:58:48.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.634+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T14:58:48.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.662+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:58:48.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.670+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:58:48.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.690+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:58:48.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.694+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:58:48.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.718+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:58:48.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.722+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:58:48.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.734+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:58:48.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.754+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:58:48.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.766+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:58:48.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:58:48.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.810+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:58:48.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.810+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:58:48.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.818+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:58:48.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.826+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:58:48.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.838+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:58:48.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.850+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:58:48.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.854+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:58:48.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.870+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:58:48.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.878+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:58:48.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.890+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:58:48.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.898+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:58:48.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.950+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:58:48.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.958+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:58:48.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.978+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:58:48.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.982+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:58:49.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:48.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:58:49.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.030+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:58:49.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.034+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:58:49.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.038+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T14:58:49.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.090+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:58:49.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.090+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:58:49.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.118+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:58:49.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.118+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:58:49.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.146+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:58:49.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.154+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T14:58:49.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.166+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:58:49.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:58:49.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.226+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:58:49.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.234+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:58:49.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:58:49.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.246+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:58:49.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.262+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:58:49.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.262+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:49.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.294+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:58:49.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.314+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:58:49.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.314+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:58:49.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.342+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T14:58:49.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.346+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:58:49.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 111 15 1214161 1214146 683.581 700.812 0.000954198 0.00145304 2024-09-16T14:58:49.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.358+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:58:49.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.394+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T14:58:49.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.466+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:58:49.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.470+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:58:49.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.502+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:58:49.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.522+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:58:49.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.526+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:58:49.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.554+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:58:49.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.570+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:58:49.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.582+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:58:49.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.590+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:58:49.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.594+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:58:49.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.602+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:58:49.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.618+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:58:49.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.626+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:58:49.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.642+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:58:49.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.662+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:49.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.670+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:58:49.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.674+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:58:49.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.694+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:58:49.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.714+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T14:58:49.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.722+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:58:49.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.758+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:58:49.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.758+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:58:49.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.786+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:58:49.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.790+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T14:58:49.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.814+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:58:49.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.854+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:58:49.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.854+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:49.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.870+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T14:58:49.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.886+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:58:49.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.902+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T14:58:49.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.914+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:58:49.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.938+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:58:49.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.962+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:58:49.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.974+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:58:49.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T14:58:49.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:49.990+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:58:50.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.002+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:58:50.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.030+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:58:50.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.054+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T14:58:50.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.078+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:58:50.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.090+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:58:50.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.094+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T14:58:50.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.102+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:58:50.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.118+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:58:50.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.150+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:58:50.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.158+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:58:50.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.166+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:58:50.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.178+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:58:50.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.210+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T14:58:50.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.210+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:58:50.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.226+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:58:50.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.242+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:58:50.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.274+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:58:50.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.282+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:58:50.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.310+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:58:50.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.310+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:58:50.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.318+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:58:50.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.334+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:58:50.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.346+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:58:50.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 112 16 1224685 1224669 683.349 657.688 0.000972807 0.00145352 2024-09-16T14:58:50.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.362+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T14:58:50.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.370+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T14:58:50.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.378+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:58:50.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.386+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:58:50.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.398+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:58:50.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:58:50.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.454+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:58:50.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.462+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:58:50.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.466+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:58:50.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.470+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:58:50.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.474+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:58:50.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.478+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:58:50.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.506+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:58:50.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.514+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:58:50.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.518+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:58:50.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.526+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:58:50.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.550+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T14:58:50.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.562+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:58:50.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.586+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:58:50.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.590+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:58:50.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.606+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:58:50.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.610+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:58:50.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.614+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:50.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.618+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:58:50.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.638+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:58:50.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.654+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:58:50.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.658+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:58:50.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.722+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T14:58:50.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.730+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:50.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.734+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:58:50.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.742+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:50.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.778+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:58:50.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.786+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:50.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.786+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:58:50.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.822+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:58:50.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.842+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:58:50.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.842+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:58:50.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.850+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T14:58:50.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.858+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:58:50.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.878+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:58:50.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.898+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:58:50.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.906+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:58:50.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.922+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:58:50.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.930+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:58:50.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.938+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:58:50.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.942+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:58:50.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.950+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:58:50.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.958+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:58:50.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:50.966+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T14:58:51.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.002+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:58:51.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.002+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T14:58:51.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.026+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:58:51.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.030+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:58:51.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.038+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:58:51.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.042+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:58:51.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.042+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T14:58:51.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.070+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:58:51.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.082+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:58:51.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.090+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:58:51.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.110+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:58:51.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.138+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:58:51.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.154+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:58:51.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.162+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T14:58:51.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.166+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:58:51.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T14:58:51.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.182+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:58:51.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.198+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:58:51.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.258+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:58:51.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.262+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:58:51.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.270+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:58:51.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.286+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:58:51.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.306+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:58:51.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.306+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T14:58:51.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.342+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:58:51.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.342+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:58:51.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.354+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:58:51.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 113 16 1235226 1235210 683.132 658.812 0.00054776 0.00145399 2024-09-16T14:58:51.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.366+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T14:58:51.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.366+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:58:51.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.370+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:58:51.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.398+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:58:51.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.402+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:58:51.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.434+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:58:51.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.446+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:58:51.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.466+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:58:51.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.474+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:58:51.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:58:51.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.510+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:58:51.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.510+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:58:51.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.538+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:51.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.566+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T14:58:51.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.570+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:58:51.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.570+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:58:51.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.586+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:58:51.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.602+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:58:51.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.610+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:58:51.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.634+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:58:51.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.670+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:58:51.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.674+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:58:51.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.686+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:58:51.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.710+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:58:51.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.722+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:58:51.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.722+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:58:51.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.734+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:58:51.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.750+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:58:51.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.758+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:58:51.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.774+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:58:51.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.798+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:58:51.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.802+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:58:51.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.818+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T14:58:51.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:58:51.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.874+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:58:51.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.890+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:58:51.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.894+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T14:58:51.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.910+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:58:51.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.922+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:58:51.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.926+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:58:51.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.930+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T14:58:51.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.958+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:58:51.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.958+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:58:51.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:51.982+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:58:52.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.002+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:58:52.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.018+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T14:58:52.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.018+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:58:52.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:58:52.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.034+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:58:52.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.034+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:58:52.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.046+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:58:52.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.086+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:58:52.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.094+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:58:52.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.106+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:58:52.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.114+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:58:52.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.130+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:58:52.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.134+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:58:52.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.150+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:58:52.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.166+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:58:52.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.170+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:58:52.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.206+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:52.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.210+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:58:52.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.234+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:58:52.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.238+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:58:52.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.266+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:58:52.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.286+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:58:52.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.294+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:58:52.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.298+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:58:52.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T14:58:52.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.342+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:58:52.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.358+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:58:52.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 114 16 1246188 1246172 683.149 685.125 0.000915486 0.00145396 2024-09-16T14:58:52.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.382+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:58:52.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.382+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:58:52.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.390+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:58:52.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.390+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:58:52.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.410+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:58:52.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.414+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T14:58:52.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.438+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:58:52.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.438+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:58:52.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.454+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:58:52.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.474+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:58:52.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.482+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:58:52.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.518+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T14:58:52.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.518+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T14:58:52.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.526+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:52.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.558+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:58:52.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.582+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:58:52.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.590+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:52.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.606+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:58:52.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.606+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:58:52.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.642+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:58:52.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.654+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:58:52.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.658+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:58:52.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.658+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:58:52.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.690+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:58:52.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.718+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:52.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.718+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:58:52.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:52.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.750+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:58:52.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.754+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:58:52.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.754+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:58:52.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.762+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:58:52.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.778+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:58:52.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.794+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:58:52.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.822+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:58:52.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.826+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:58:52.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.830+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:58:52.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.858+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:58:52.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.866+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:58:52.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.870+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:58:52.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.878+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:58:52.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.886+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:58:52.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.922+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:58:52.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.934+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:58:52.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:58:52.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.974+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:58:52.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:58:53.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:52.994+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:58:53.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.010+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:58:53.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.018+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:58:53.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:58:53.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.070+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:58:53.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.070+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:58:53.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.074+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:58:53.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.086+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T14:58:53.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.094+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:58:53.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.114+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:53.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.130+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:58:53.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.142+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:53.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:58:53.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.166+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:53.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.166+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:58:53.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.174+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:58:53.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.190+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:58:53.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.218+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:58:53.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.234+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:58:53.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.250+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:58:53.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.258+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:58:53.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.266+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:53.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.274+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:58:53.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.278+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:53.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.302+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:58:53.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.310+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:58:53.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.338+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:58:53.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.358+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:58:53.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T14:58:53.365 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 115 16 1257006 1256990 683.087 676.125 0.00110974 0.0014541 2024-09-16T14:58:53.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.370+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:58:53.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.374+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:58:53.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:53.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.414+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:58:53.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.422+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:58:53.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.430+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:58:53.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:58:53.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.446+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T14:58:53.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.458+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:58:53.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.502+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:58:53.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.522+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:58:53.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.534+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:58:53.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.554+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:58:53.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.582+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:58:53.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.594+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:58:53.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.622+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:58:53.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.638+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T14:58:53.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.642+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:58:53.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.646+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:58:53.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.654+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:58:53.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.678+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:58:53.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.682+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:58:53.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.690+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:58:53.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.734+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:58:53.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.742+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:58:53.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.754+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:58:53.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.770+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:58:53.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.778+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T14:58:53.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.786+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:58:53.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.790+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:58:53.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.806+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:58:53.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.814+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:58:53.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.838+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:58:53.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.842+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:58:53.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.842+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:58:53.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.882+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:58:53.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.898+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:58:53.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.918+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:58:53.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.922+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:53.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.938+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T14:58:53.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:58:53.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.954+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:58:54.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:58:54.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.994+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:58:54.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:53.998+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:58:54.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.002+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:58:54.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.054+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:58:54.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.054+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T14:58:54.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.058+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:58:54.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.074+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T14:58:54.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.110+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:58:54.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.126+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:58:54.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.158+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:58:54.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.170+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:58:54.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.174+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:58:54.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.178+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T14:58:54.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.190+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:58:54.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.194+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:58:54.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.238+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:58:54.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.246+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:58:54.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.258+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:58:54.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.270+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:58:54.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.274+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:58:54.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.286+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:58:54.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.294+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:58:54.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.298+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:58:54.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.298+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T14:58:54.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.322+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:58:54.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.338+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:58:54.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 116 15 1268175 1268160 683.216 698.125 0.000760436 0.00145376 2024-09-16T14:58:54.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.386+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:58:54.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.398+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:58:54.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.410+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:58:54.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.422+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:58:54.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.430+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:58:54.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.438+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:58:54.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.442+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:58:54.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.446+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T14:58:54.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.534+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:58:54.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.558+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:58:54.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.562+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:58:54.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.582+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T14:58:54.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.586+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:58:54.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.590+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:58:54.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.618+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:54.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.658+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T14:58:54.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.662+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:58:54.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.670+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:58:54.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.686+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:58:54.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.690+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:58:54.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.698+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:58:54.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.722+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:58:54.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.738+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:58:54.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.746+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:58:54.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.746+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:58:54.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.758+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T14:58:54.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.766+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:58:54.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:58:54.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.814+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:58:54.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.842+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T14:58:54.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.846+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:58:54.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.878+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:58:54.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.890+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:58:54.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.894+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T14:58:54.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.894+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:58:54.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.898+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:58:54.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.914+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:58:54.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.938+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:54.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.950+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:58:54.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:58:54.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.982+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T14:58:54.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.990+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:58:55.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:54.998+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:58:55.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:58:55.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.010+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:58:55.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.014+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:55.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.042+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:58:55.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.070+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:58:55.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.078+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:58:55.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.094+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:58:55.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.134+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:58:55.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.142+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:58:55.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.166+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:58:55.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.170+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:58:55.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.178+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:58:55.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.202+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:58:55.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.242+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T14:58:55.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.250+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:58:55.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T14:58:55.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.278+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:58:55.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.286+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:58:55.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.298+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:58:55.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.302+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:58:55.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.318+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:58:55.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.326+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:58:55.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.334+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:58:55.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.346+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T14:58:55.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.354+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T14:58:55.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 117 16 1278525 1278509 682.905 646.812 0.00072494 0.00145447 2024-09-16T14:58:55.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.366+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:58:55.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.386+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:58:55.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:58:55.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.402+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:55.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.414+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:58:55.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.434+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:58:55.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:58:55.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.466+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:58:55.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.470+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:58:55.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.474+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T14:58:55.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.478+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:58:55.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.502+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:58:55.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:55.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.514+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:58:55.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.550+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:58:55.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.554+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T14:58:55.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.578+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:58:55.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.590+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:58:55.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.590+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T14:58:55.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.594+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:58:55.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.598+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:58:55.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.670+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:58:55.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.682+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:58:55.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.698+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:58:55.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.710+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:58:55.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.722+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:58:55.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.742+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:58:55.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.750+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:55.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.754+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:58:55.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.762+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T14:58:55.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.782+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:58:55.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.802+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:58:55.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.818+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:58:55.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.830+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:58:55.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.838+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:58:55.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.854+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T14:58:55.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.866+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:58:55.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.878+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:58:55.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:58:55.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.918+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:58:55.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.942+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:58:55.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.950+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:58:55.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.950+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:58:55.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:55.962+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:58:56.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.082+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:58:56.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.086+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:56.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.106+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:58:56.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.130+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:58:56.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.142+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:58:56.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.174+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T14:58:56.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.182+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:58:56.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.186+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:58:56.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.214+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:58:56.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.242+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:58:56.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.250+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:58:56.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.254+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T14:58:56.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.278+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:58:56.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.282+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T14:58:56.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.314+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T14:58:56.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.318+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:58:56.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.322+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T14:58:56.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.330+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:58:56.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.342+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:58:56.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T14:58:56.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 118 16 1287914 1287898 682.09 586.812 0.00110342 0.00145619 2024-09-16T14:58:56.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.374+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:56.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.394+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:58:56.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.402+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:58:56.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.430+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:58:56.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.466+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:58:56.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.470+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:58:56.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.498+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:58:56.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.510+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:58:56.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.522+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:58:56.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.530+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T14:58:56.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.558+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:58:56.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.566+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:58:56.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.570+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:58:56.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.578+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:58:56.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.598+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:58:56.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.598+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:56.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.610+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:58:56.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.618+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:58:56.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.658+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:58:56.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.686+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:58:56.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.694+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:58:56.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.694+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:58:56.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.702+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:58:56.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.718+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:58:56.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.722+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:58:56.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.730+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T14:58:56.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.738+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:58:56.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.778+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:58:56.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.806+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:58:56.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.826+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:58:56.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.834+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:58:56.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.866+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T14:58:56.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.878+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:58:56.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.886+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:58:56.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.890+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:58:56.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.898+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:58:56.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.914+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:58:56.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.926+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T14:58:56.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.946+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:58:56.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.950+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:58:56.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.974+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:58:56.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:56.982+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:58:57.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.006+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:58:57.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.018+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:58:57.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.026+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:58:57.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.058+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T14:58:57.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.074+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:58:57.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.078+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:58:57.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.090+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:58:57.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.110+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T14:58:57.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.118+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T14:58:57.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.126+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:57.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.134+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:58:57.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.134+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:58:57.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.166+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:58:57.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.186+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:57.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.194+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:58:57.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.222+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:58:57.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.226+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:58:57.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.230+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:58:57.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.250+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:58:57.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.266+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:58:57.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.286+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T14:58:57.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.294+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:58:57.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.310+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:58:57.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.330+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:58:57.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:58:57.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 119 16 1298703 1298687 682.024 674.312 0.000917889 0.00145638 2024-09-16T14:58:57.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.362+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:58:57.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.366+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:58:57.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.390+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:58:57.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.414+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:58:57.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.434+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:58:57.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.462+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:58:57.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.466+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:58:57.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.478+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:58:57.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.490+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:57.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.510+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:58:57.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.522+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:58:57.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.522+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:58:57.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.526+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:58:57.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.542+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:58:57.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.558+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T14:58:57.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.606+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T14:58:57.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.614+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:58:57.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.630+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T14:58:57.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.634+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:58:57.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.666+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:58:57.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.674+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:58:57.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.702+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:58:57.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.702+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T14:58:57.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:58:57.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.746+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:58:57.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.758+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:58:57.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.770+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:58:57.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.782+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:58:57.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.786+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:58:57.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.802+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:58:57.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.814+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:58:57.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.830+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:58:57.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.846+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:58:57.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.850+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:58:57.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.858+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:58:57.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.866+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:58:57.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.882+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:58:57.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.882+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:58:57.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.922+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:58:57.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.942+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:58:57.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.962+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:58:57.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:58:57.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.986+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:58:57.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.986+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:58:58.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:57.998+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:58:58.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.018+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:58.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.022+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T14:58:58.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.042+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:58:58.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.054+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:58:58.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.066+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:58:58.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.074+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:58:58.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.074+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:58:58.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.086+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:58:58.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.090+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:58:58.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.094+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:58:58.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.122+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:58:58.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.130+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T14:58:58.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.154+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:58:58.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.182+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:58:58.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.198+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:58:58.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.202+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:58:58.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.246+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:58.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.274+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:58:58.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.278+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:58:58.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:58:58.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.318+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:58:58.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.334+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:58:58.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.350+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T14:58:58.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.354+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:58:58.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.358+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:58:58.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:58:58.366012+0000 min lat: 0.000220975 max lat: 0.16813 avg lat: 0.00145605 2024-09-16T14:58:58.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:58:58.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 120 16 1309901 1309885 682.172 699.875 0.000884214 0.00145605 2024-09-16T14:58:58.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.366+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:58:58.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.406+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:58:58.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.434+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:58:58.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.450+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:58:58.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.458+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:58:58.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.474+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T14:58:58.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:58:58.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.502+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:58:58.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.510+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:58:58.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.522+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:58:58.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.526+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:58:58.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.530+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:58:58.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.554+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:58:58.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.562+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:58:58.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.574+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:58:58.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.590+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:58:58.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.606+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:58:58.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.626+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:58:58.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.638+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:58:58.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.646+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:58:58.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.654+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:58:58.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.662+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:58:58.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.670+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:58:58.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.682+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:58:58.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.726+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:58:58.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.726+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:58:58.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:58:58.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.746+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:58:58.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.754+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:58:58.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:58:58.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.778+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:58:58.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.802+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:58:58.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.806+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T14:58:58.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.822+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:58:58.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.846+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:58:58.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.850+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:58:58.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.874+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:58:58.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.874+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:58:58.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.882+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:58:58.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.914+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T14:58:58.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.918+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:58:58.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.950+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T14:58:58.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.970+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:58:58.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.974+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:58:59.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:58.994+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:58:59.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.002+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:58:59.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.010+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:58:59.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.018+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:58:59.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.030+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:58:59.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.042+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T14:58:59.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.094+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:58:59.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.114+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:58:59.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.118+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:58:59.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.142+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:58:59.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.146+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:58:59.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.190+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:58:59.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.194+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T14:58:59.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.210+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:58:59.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.222+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:58:59.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.230+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:58:59.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.234+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:58:59.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.242+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:58:59.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.258+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T14:58:59.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.286+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:58:59.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.290+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:58:59.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.306+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:58:59.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.314+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:58:59.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.314+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:58:59.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.334+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:58:59.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 121 16 1321117 1321101 682.327 701 0.00421346 0.00145573 2024-09-16T14:58:59.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.362+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:58:59.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:58:59.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.390+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:58:59.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.390+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:58:59.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.394+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:58:59.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:58:59.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.430+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:58:59.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.466+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:58:59.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.490+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:58:59.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.494+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:58:59.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.506+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:58:59.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.510+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:58:59.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.526+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T14:58:59.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.562+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:58:59.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.562+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:58:59.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.578+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:58:59.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:58:59.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.610+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:58:59.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.626+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T14:58:59.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.630+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:58:59.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.646+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:58:59.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.650+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:58:59.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.682+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:58:59.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.690+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:58:59.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.698+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:58:59.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.730+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:58:59.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.738+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:58:59.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.750+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:58:59.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.750+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:58:59.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.754+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T14:58:59.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.766+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:58:59.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.774+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T14:58:59.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.794+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:58:59.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.794+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:58:59.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.826+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:58:59.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.842+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:58:59.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.862+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:58:59.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.882+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:58:59.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:58:59.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T14:58:59.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.906+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:58:59.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.910+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:58:59.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.918+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:58:59.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.974+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:58:59.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:58:59.990+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:00.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.010+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:59:00.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.022+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:59:00.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.026+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:59:00.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:59:00.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.038+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:59:00.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.070+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:59:00.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.070+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:59:00.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.086+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:59:00.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.098+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:59:00.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.126+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T14:59:00.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.134+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:59:00.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.146+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T14:59:00.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.166+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:59:00.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.190+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T14:59:00.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.222+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:59:00.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.238+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:59:00.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.262+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:59:00.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:59:00.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.290+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:59:00.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:59:00.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.298+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:59:00.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.302+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:59:00.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.318+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T14:59:00.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.354+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:59:00.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 122 15 1332167 1332152 682.395 690.688 0.00111895 0.00145558 2024-09-16T14:59:00.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.370+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:00.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.378+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:00.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.390+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:59:00.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.406+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:59:00.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.406+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:59:00.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.446+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:59:00.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.482+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:59:00.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.498+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:59:00.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.514+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T14:59:00.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.518+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:59:00.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.522+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:59:00.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.558+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:59:00.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.582+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:59:00.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.598+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:59:00.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.606+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:00.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.634+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:59:00.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.638+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:59:00.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.666+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:59:00.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.666+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:59:00.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.682+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:59:00.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.714+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:59:00.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.714+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:59:00.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.718+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:59:00.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.754+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:59:00.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.758+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:59:00.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.786+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:59:00.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.798+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:59:00.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.810+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:59:00.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.834+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:00.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.846+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:59:00.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.850+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:59:00.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.854+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:59:00.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.866+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:59:00.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.902+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:59:00.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.906+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:59:00.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.934+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:59:00.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.934+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:59:00.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.942+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T14:59:00.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.958+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:59:00.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.966+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:59:00.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.990+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:59:01.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:00.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:59:01.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.014+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:59:01.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.026+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:59:01.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.030+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:59:01.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.066+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:01.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.106+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:59:01.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.110+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:59:01.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.118+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:59:01.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.122+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:01.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.146+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T14:59:01.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.146+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:59:01.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.174+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:59:01.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.194+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:59:01.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.226+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:59:01.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.238+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T14:59:01.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.250+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:59:01.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.262+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:01.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.274+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:59:01.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.282+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:01.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.286+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:59:01.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.318+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:59:01.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.322+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:59:01.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.334+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:59:01.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.334+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:59:01.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.358+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:59:01.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 123 16 1342782 1342766 682.24 663.375 0.000828352 0.00145583 2024-09-16T14:59:01.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.374+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:59:01.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.390+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T14:59:01.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.402+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:59:01.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.410+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:59:01.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.426+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:59:01.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.442+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:59:01.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.462+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:59:01.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.482+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:59:01.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.502+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:59:01.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.502+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:59:01.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.506+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:59:01.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.526+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:59:01.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.538+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:59:01.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.546+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:59:01.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.546+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:01.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.558+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:59:01.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.566+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:59:01.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.566+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:59:01.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.598+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T14:59:01.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.618+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:01.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.618+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:59:01.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.638+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:59:01.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.654+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:01.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.654+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:59:01.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.662+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:59:01.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.682+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:59:01.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.690+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:59:01.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.714+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:59:01.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.722+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:59:01.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.750+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T14:59:01.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.754+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:59:01.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.758+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:59:01.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:59:01.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.806+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:59:01.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.814+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T14:59:01.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.814+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:59:01.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.822+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:59:01.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.834+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:01.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.862+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:59:01.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.862+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:59:01.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.894+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:59:01.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.898+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:59:01.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.902+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:59:01.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.926+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:59:01.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.942+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:59:01.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T14:59:01.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.954+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:59:01.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.986+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:59:01.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:01.986+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:59:02.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.010+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:59:02.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.014+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:59:02.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.018+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:59:02.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:59:02.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.038+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:59:02.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.050+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:59:02.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.074+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:02.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.098+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:59:02.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.102+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:59:02.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.138+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:59:02.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.142+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:59:02.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.162+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:59:02.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.190+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:59:02.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.198+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:59:02.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.218+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:59:02.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.222+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T14:59:02.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.222+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:59:02.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.230+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:59:02.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.246+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:59:02.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.262+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:59:02.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.306+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:59:02.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.314+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:59:02.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.342+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:59:02.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.346+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:59:02.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.354+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T14:59:02.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 124 16 1353652 1353636 682.217 679.375 0.00117644 0.00145596 2024-09-16T14:59:02.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.378+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:59:02.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.410+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:59:02.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.410+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:59:02.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.434+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:59:02.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.438+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:59:02.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.442+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:59:02.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.478+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:59:02.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.482+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:59:02.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.490+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:59:02.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.498+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T14:59:02.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.502+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:59:02.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.542+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:59:02.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.554+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T14:59:02.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.574+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:02.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.586+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:02.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.598+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:59:02.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.598+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:59:02.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.626+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:59:02.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.630+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:59:02.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.642+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:59:02.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.678+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:59:02.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.682+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:02.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.698+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:59:02.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.722+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:59:02.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.726+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:59:02.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:59:02.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.766+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:59:02.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.778+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:59:02.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.782+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:59:02.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.794+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:59:02.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.802+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:59:02.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.858+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T14:59:02.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.866+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:59:02.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.874+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:59:02.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.890+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:59:02.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.898+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:59:02.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.918+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:59:02.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.918+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T14:59:02.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.946+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T14:59:02.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.970+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:59:02.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.974+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:59:02.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.974+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:59:02.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:02.974+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T14:59:03.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.010+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T14:59:03.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.010+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:59:03.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.030+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:59:03.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.034+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:03.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.046+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:59:03.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.058+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:59:03.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.058+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:59:03.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.058+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:59:03.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.066+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:59:03.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.114+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:59:03.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.118+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:59:03.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.130+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:59:03.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.146+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T14:59:03.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.166+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T14:59:03.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.194+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:59:03.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.210+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T14:59:03.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.214+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:59:03.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.222+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T14:59:03.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.226+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:59:03.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.230+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:59:03.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.254+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:59:03.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.270+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T14:59:03.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.278+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:59:03.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.302+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:59:03.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.302+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T14:59:03.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.314+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:59:03.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.322+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:59:03.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.338+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:59:03.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.342+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:59:03.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.350+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T14:59:03.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 125 16 1364593 1364577 682.229 683.812 0.00243578 0.00145591 2024-09-16T14:59:03.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.366+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:59:03.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.394+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:59:03.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.402+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:59:03.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.406+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T14:59:03.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.462+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:59:03.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.462+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T14:59:03.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.478+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:59:03.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.486+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:59:03.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.490+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:59:03.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.490+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:59:03.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.518+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:59:03.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.518+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:59:03.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.534+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:03.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.550+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T14:59:03.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.566+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:59:03.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.610+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T14:59:03.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.630+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T14:59:03.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.638+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:59:03.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.642+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:59:03.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.678+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:59:03.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.682+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T14:59:03.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.686+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:59:03.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.718+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T14:59:03.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.722+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:03.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.730+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:59:03.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.746+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:59:03.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.758+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:59:03.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.786+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:59:03.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.790+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:59:03.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.794+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:59:03.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.810+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:59:03.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:59:03.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.830+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:59:03.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.846+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:59:03.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.870+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T14:59:03.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.878+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:03.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.894+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:59:03.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.922+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:59:03.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.926+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:59:03.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.946+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:59:03.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.958+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:59:03.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.962+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:59:03.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.978+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:59:03.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.978+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:59:03.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:03.982+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:59:04.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.018+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:59:04.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.034+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:59:04.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.038+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:59:04.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.054+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T14:59:04.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.054+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:59:04.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.058+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:04.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.066+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:04.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.090+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T14:59:04.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.094+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:59:04.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.110+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:59:04.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.134+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:04.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.166+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:04.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.170+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:59:04.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.190+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:59:04.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.194+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:59:04.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.206+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:59:04.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.226+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:59:04.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.242+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:04.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.258+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:59:04.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.286+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:59:04.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.290+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T14:59:04.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.318+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:59:04.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.322+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:59:04.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.342+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:59:04.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.342+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T14:59:04.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 126 15 1375633 1375618 682.291 690.062 0.00119374 0.0014558 2024-09-16T14:59:04.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.362+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:59:04.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.362+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:59:04.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.378+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:59:04.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.382+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:59:04.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:04.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.434+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:59:04.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.434+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:59:04.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.462+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:04.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.502+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:59:04.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.502+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:59:04.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.546+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:59:04.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.558+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:59:04.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.578+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:59:04.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.582+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T14:59:04.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.606+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:59:04.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.618+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:59:04.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.670+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:59:04.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.674+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:04.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.698+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:59:04.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.718+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:59:04.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.734+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:59:04.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.754+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:59:04.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.754+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:59:04.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.762+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T14:59:04.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:04.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.794+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T14:59:04.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.814+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:59:04.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.818+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:59:04.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.834+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:59:04.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.846+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:59:04.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.846+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:59:04.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:59:04.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.890+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:59:04.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.894+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:59:04.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.910+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T14:59:04.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.914+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:59:04.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.938+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:04.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.942+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:59:04.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.974+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:59:04.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.982+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:59:05.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:04.998+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:59:05.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.002+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:59:05.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:05.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.050+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:59:05.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.058+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:59:05.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.078+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:59:05.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.082+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:59:05.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.098+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:59:05.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.102+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:59:05.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.118+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:59:05.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.122+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:59:05.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.138+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:59:05.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.158+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:05.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.182+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:59:05.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.186+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T14:59:05.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.186+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:59:05.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.218+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:59:05.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.230+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:05.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.250+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:59:05.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.254+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:59:05.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.278+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:59:05.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.298+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:59:05.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.302+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:59:05.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.310+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:05.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.322+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:05.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.334+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:59:05.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.342+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:59:05.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.350+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T14:59:05.366 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 127 16 1386786 1386770 682.406 697 0.00123688 0.0014555 2024-09-16T14:59:05.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.366+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:05.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.410+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:05.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.422+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:59:05.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.422+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:59:05.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.454+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:59:05.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.470+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:05.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.486+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:59:05.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.498+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:59:05.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.502+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:59:05.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.546+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:59:05.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.546+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:59:05.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.574+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:59:05.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.578+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:59:05.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.598+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:59:05.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.598+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:59:05.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.606+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:59:05.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.606+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:59:05.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.650+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:59:05.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.662+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:05.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.670+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:59:05.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.702+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:59:05.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.706+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:59:05.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.706+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:59:05.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.730+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:05.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.770+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:59:05.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.786+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:59:05.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.786+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:59:05.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.810+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:59:05.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.822+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:59:05.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.842+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:59:05.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.870+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T14:59:05.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.882+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:05.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.898+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:59:05.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.906+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:59:05.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.906+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:59:05.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.926+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T14:59:05.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.938+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:59:05.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.938+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:59:05.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.962+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:59:05.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.966+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:59:05.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:05.974+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:59:06.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.006+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:59:06.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.010+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:06.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.010+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:59:06.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.022+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:59:06.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.054+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:59:06.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.054+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:59:06.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.062+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:59:06.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.078+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T14:59:06.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.078+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:59:06.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.090+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:59:06.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.094+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:59:06.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.114+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:06.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.118+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T14:59:06.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.138+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:59:06.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.146+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:06.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.186+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:59:06.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.194+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:59:06.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.210+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:59:06.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.222+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:59:06.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.234+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T14:59:06.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:59:06.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.250+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T14:59:06.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.254+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:59:06.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.282+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:59:06.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.298+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:59:06.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.298+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T14:59:06.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.330+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:59:06.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.330+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T14:59:06.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.342+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:59:06.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.350+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:59:06.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.358+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:59:06.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.358+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:59:06.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 128 16 1397723 1397707 682.415 683.562 0.00231599 0.00145552 2024-09-16T14:59:06.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.378+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T14:59:06.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.410+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:59:06.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.438+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:59:06.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.442+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:59:06.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.450+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T14:59:06.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.458+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:59:06.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.470+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:06.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.494+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:59:06.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.498+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:59:06.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.526+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:59:06.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.530+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:59:06.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:59:06.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.574+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T14:59:06.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.582+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:59:06.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.582+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:59:06.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.602+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:06.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.606+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:59:06.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.638+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:06.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.642+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T14:59:06.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.666+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:59:06.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.702+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:59:06.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.706+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:59:06.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.722+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T14:59:06.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.730+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:59:06.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.730+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:59:06.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.738+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:59:06.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.770+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:59:06.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.782+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:59:06.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.786+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T14:59:06.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.790+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:59:06.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.802+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:59:06.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.846+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:59:06.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.870+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:59:06.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.890+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:59:06.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.930+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:59:06.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.958+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:59:06.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.970+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:59:06.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.974+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:59:06.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.978+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:59:06.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:06.994+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T14:59:07.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.034+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:59:07.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.042+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T14:59:07.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.062+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T14:59:07.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.078+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:59:07.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.082+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:07.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.102+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:59:07.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.118+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:59:07.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.162+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:07.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.182+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:59:07.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:07.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.210+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:59:07.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.226+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:59:07.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.234+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:59:07.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.254+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:07.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.262+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T14:59:07.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:59:07.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.278+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:59:07.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.278+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:59:07.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.334+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:59:07.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.334+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:59:07.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.350+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:59:07.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.350+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:59:07.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 129 16 1409080 1409064 682.627 709.812 0.000669653 0.00145509 2024-09-16T14:59:07.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:07.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.386+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:59:07.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.406+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:59:07.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.414+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T14:59:07.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:07.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.438+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:59:07.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.454+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:59:07.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.466+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:59:07.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.490+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:59:07.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.526+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:59:07.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.538+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:59:07.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.550+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:59:07.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.554+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:59:07.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.574+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:59:07.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.578+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:59:07.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.586+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:59:07.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.606+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:59:07.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.610+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:59:07.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.630+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T14:59:07.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.642+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T14:59:07.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.666+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:59:07.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.674+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:07.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.686+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:59:07.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.698+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T14:59:07.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.730+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:59:07.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.734+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:59:07.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.734+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:59:07.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.766+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:59:07.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.770+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:59:07.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.774+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:59:07.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.810+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:59:07.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.814+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:59:07.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.818+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:59:07.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.846+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:59:07.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.846+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:59:07.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.870+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:59:07.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.874+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:59:07.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.874+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T14:59:07.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.886+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:07.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.922+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:59:07.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.946+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:07.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.950+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:07.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.978+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:59:07.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.982+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:59:07.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.990+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:59:08.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:07.998+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:59:08.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.038+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:59:08.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.050+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:59:08.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.058+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:59:08.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.058+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T14:59:08.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.066+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:59:08.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.078+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T14:59:08.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.134+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:59:08.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.146+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:08.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.146+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T14:59:08.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.162+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:59:08.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.182+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:59:08.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.190+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T14:59:08.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.202+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:59:08.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.206+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T14:59:08.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.230+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:08.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.258+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T14:59:08.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:59:08.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.282+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:59:08.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.282+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:59:08.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.298+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:59:08.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.314+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:08.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.326+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:59:08.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.334+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T14:59:08.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.334+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:59:08.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 130 16 1420268 1420252 682.754 699.25 0.0040143 0.00145478 2024-09-16T14:59:08.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.366+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:59:08.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.382+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T14:59:08.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.402+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:59:08.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.406+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:59:08.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.406+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:08.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.410+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T14:59:08.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.418+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T14:59:08.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.422+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:08.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.434+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T14:59:08.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.450+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:59:08.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.470+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:59:08.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.486+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T14:59:08.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.510+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:59:08.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.514+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:59:08.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.542+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:59:08.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.574+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:59:08.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.594+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:59:08.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.606+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:59:08.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.634+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:59:08.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.642+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:59:08.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.662+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:59:08.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.662+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:59:08.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.686+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:59:08.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.710+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:59:08.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.726+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:59:08.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.726+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:08.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.746+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:59:08.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.754+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:59:08.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.766+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T14:59:08.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.790+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T14:59:08.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.790+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T14:59:08.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.806+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:08.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.818+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:59:08.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:59:08.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.830+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:59:08.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.846+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:59:08.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.878+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T14:59:08.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.906+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:59:08.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.914+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:59:08.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.954+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:59:08.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.966+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:59:08.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.970+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:59:08.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.982+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:59:09.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.994+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:59:09.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:08.998+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:59:09.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:59:09.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.014+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:09.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.014+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:59:09.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.062+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T14:59:09.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.070+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:59:09.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.070+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T14:59:09.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.086+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:09.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.098+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:59:09.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.126+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:59:09.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.138+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:59:09.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.146+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:59:09.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.154+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:59:09.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.170+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:59:09.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.178+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:59:09.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.190+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:59:09.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.194+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:59:09.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.198+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T14:59:09.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.218+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T14:59:09.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.234+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:59:09.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.234+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:59:09.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.234+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:59:09.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.274+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T14:59:09.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.274+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:59:09.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.286+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:59:09.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.298+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:59:09.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:59:09.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.318+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:09.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.338+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:59:09.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.338+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T14:59:09.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.346+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:59:09.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 131 15 1431191 1431176 682.754 682.75 0.00108447 0.00145479 2024-09-16T14:59:09.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.370+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:59:09.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.374+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:59:09.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.398+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:59:09.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.422+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:59:09.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.442+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:59:09.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.462+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T14:59:09.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.466+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:59:09.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.498+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:59:09.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.510+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T14:59:09.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:59:09.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.518+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:59:09.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.610+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:09.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.614+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:59:09.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.638+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:59:09.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.646+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:59:09.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.646+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:09.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.670+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:59:09.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.678+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:59:09.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:09.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.746+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:59:09.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.774+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:59:09.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.774+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:59:09.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.782+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T14:59:09.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.798+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:59:09.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.802+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:59:09.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.850+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T14:59:09.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.854+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:59:09.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.874+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T14:59:09.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.878+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:59:09.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.882+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:59:09.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.922+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:59:09.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.930+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T14:59:09.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.934+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:59:09.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.934+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:59:09.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.938+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:59:09.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T14:59:09.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.962+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:59:10.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:09.998+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:59:10.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.038+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:59:10.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.058+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T14:59:10.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.062+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:59:10.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.070+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T14:59:10.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.102+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:59:10.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.102+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:59:10.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.118+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:59:10.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.122+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:59:10.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.158+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:10.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.182+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:59:10.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.194+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:59:10.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:59:10.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.214+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:59:10.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.218+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:59:10.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.218+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T14:59:10.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.218+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:59:10.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.262+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:59:10.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.278+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:59:10.537 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 132 16 1441791 1441775 682.599 662.438 0.00141291 0.00145515 2024-09-16T14:59:10.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.286+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.286+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.298+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.310+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.310+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.354+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.358+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.366+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.382+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.382+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.398+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.422+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.422+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T14:59:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.426+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T14:59:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.454+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:59:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.482+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:59:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:59:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.510+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:59:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.518+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T14:59:10.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.550+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:59:10.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.554+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:59:10.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.554+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:59:10.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.566+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:10.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:59:10.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.614+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:59:10.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.622+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:59:10.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.630+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:59:10.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.666+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:59:10.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.670+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:10.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.682+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:59:10.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.698+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T14:59:10.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.718+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:59:10.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.730+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:59:10.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.738+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T14:59:10.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:59:10.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.754+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:59:10.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.762+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:10.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.790+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:59:10.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.794+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:59:10.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.814+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:59:10.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.822+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:10.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.846+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:59:10.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.858+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:59:10.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.870+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:59:10.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.898+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:59:10.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.922+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T14:59:10.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:59:10.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.966+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:59:10.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.966+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:59:10.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:10.970+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:59:11.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.030+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:59:11.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.034+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:59:11.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.054+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:59:11.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.090+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:59:11.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.094+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:59:11.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.114+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:59:11.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.118+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:59:11.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.170+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:59:11.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.170+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:59:11.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.170+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:59:11.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.194+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:59:11.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.218+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T14:59:11.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T14:59:11.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.250+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:59:11.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.258+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T14:59:11.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.266+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:11.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.278+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:59:11.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.278+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:59:11.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.294+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:59:11.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.302+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T14:59:11.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.310+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:59:11.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.322+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:59:11.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.354+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:59:11.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 133 16 1452786 1452770 682.632 687.188 0.00162599 0.00145505 2024-09-16T14:59:11.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.378+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T14:59:11.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.382+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:59:11.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.386+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:59:11.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.410+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:59:11.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.414+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:59:11.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.422+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:59:11.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:59:11.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.450+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:59:11.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.454+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:11.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.498+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:59:11.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.510+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:59:11.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.514+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T14:59:11.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.518+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:59:11.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.526+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T14:59:11.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.542+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:59:11.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.546+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:59:11.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.590+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T14:59:11.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.602+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:59:11.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.606+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:11.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.630+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:59:11.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.638+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:59:11.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.650+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:59:11.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.662+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:59:11.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.666+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:59:11.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.686+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:59:11.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.694+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:59:11.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.710+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:59:11.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.714+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:59:11.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.726+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T14:59:11.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.758+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:59:11.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.762+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T14:59:11.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.778+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:59:11.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.786+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:59:11.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.794+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:59:11.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.806+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:59:11.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.822+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:59:11.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.826+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:59:11.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.854+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:59:11.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.870+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:59:11.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.870+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:11.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.874+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T14:59:11.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.898+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:59:11.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.918+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:59:11.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.922+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:59:11.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.934+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:59:11.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.962+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:59:11.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:11.974+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:59:12.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.006+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:12.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.026+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T14:59:12.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.030+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:59:12.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.046+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:59:12.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.046+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:12.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.062+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T14:59:12.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.066+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T14:59:12.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.086+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:59:12.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.098+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:59:12.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.106+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:59:12.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.122+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:59:12.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.174+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:59:12.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.178+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:59:12.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.190+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:59:12.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.206+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:59:12.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.222+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:59:12.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.238+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:59:12.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.238+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T14:59:12.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.262+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:59:12.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.278+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:12.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.286+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:59:12.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.286+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:12.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.298+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:59:12.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.306+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:59:12.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.326+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T14:59:12.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.358+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T14:59:12.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 134 16 1463899 1463883 682.721 694.562 0.00108388 0.0014549 2024-09-16T14:59:12.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.362+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:59:12.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.398+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:59:12.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.398+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:59:12.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.402+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:59:12.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.414+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:59:12.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.418+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:59:12.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.446+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:59:12.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.462+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:59:12.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.462+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:59:12.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.466+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:59:12.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.478+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:59:12.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:59:12.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.506+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:59:12.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.510+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:59:12.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.514+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T14:59:12.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.522+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T14:59:12.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.542+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:59:12.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.582+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T14:59:12.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.586+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:59:12.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.614+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:59:12.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.618+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:59:12.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.626+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:12.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.630+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:59:12.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.654+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:59:12.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.670+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:59:12.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.698+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:59:12.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.706+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:59:12.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.722+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T14:59:12.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.746+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:59:12.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.750+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:59:12.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.754+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:59:12.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.766+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T14:59:12.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.798+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:59:12.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.802+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:59:12.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.802+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:59:12.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.854+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:12.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:59:12.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.870+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:59:12.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.874+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:59:12.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.894+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T14:59:12.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.894+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:59:12.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.898+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:59:12.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.898+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:59:12.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.918+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:59:12.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T14:59:12.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.966+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:59:12.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.966+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:12.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.966+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:59:12.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.970+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:59:13.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:12.998+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:59:13.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.042+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:59:13.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.050+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:59:13.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.070+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:59:13.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.070+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:13.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.090+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:59:13.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.094+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:59:13.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.134+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:59:13.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.134+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:59:13.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.162+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:59:13.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.182+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:13.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.186+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:59:13.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.194+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:59:13.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.206+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:59:13.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.226+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:59:13.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.230+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:59:13.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.230+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:59:13.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.234+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:59:13.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:59:13.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.282+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:13.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.290+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:59:13.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.298+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:59:13.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.302+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T14:59:13.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.314+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:13.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.318+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:59:13.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 135 16 1474652 1474636 682.642 672.062 0.00106478 0.00145501 2024-09-16T14:59:13.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.362+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:59:13.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.362+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T14:59:13.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.374+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:59:13.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.398+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:59:13.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.398+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:59:13.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.422+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:59:13.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.426+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T14:59:13.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T14:59:13.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.454+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:59:13.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.470+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:59:13.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.522+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T14:59:13.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.530+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T14:59:13.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.558+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:59:13.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.566+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:59:13.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.582+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:59:13.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.586+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:59:13.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.590+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:59:13.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.594+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:13.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.618+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:59:13.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.650+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:13.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.650+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:13.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.658+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:59:13.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.678+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T14:59:13.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.686+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:59:13.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.690+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:59:13.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.714+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:59:13.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.722+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:59:13.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.726+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:59:13.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.738+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:59:13.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.758+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T14:59:13.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.766+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:59:13.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.766+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:13.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.778+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:59:13.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.786+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:59:13.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.790+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:59:13.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.798+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:59:13.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.810+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:59:13.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:59:13.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.858+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:59:13.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.882+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:59:13.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.902+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:59:13.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.906+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:13.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.910+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:59:13.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.934+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:59:13.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.942+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T14:59:13.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.962+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:59:13.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.962+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:59:13.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.982+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T14:59:13.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.982+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:59:13.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.986+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T14:59:14.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:13.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:59:14.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.026+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:59:14.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.038+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:59:14.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.042+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:59:14.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.070+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:59:14.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.094+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:59:14.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.106+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:59:14.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.114+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:59:14.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.146+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:59:14.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.170+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:14.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:59:14.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.190+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:59:14.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.206+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:59:14.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.210+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:59:14.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.222+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T14:59:14.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.230+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T14:59:14.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.242+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:59:14.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.242+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:14.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.290+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:59:14.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.298+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:59:14.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T14:59:14.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.330+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:14.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.350+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T14:59:14.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:59:14.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 136 16 1485579 1485563 682.643 682.938 0.00102646 0.00145505 2024-09-16T14:59:14.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.366+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:14.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.374+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T14:59:14.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.386+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T14:59:14.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:59:14.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.434+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:59:14.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.446+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T14:59:14.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.450+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:14.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.474+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:59:14.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.478+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:59:14.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.486+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:59:14.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.494+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T14:59:14.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.510+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:59:14.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.522+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:59:14.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.538+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:59:14.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.542+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:59:14.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.574+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:59:14.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.582+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:59:14.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.594+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:59:14.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.598+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:59:14.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.630+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:59:14.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.634+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:59:14.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.638+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:59:14.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.674+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T14:59:14.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.686+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:59:14.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.698+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:59:14.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.710+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:59:14.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.734+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:59:14.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.746+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:59:14.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.750+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T14:59:14.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.766+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:59:14.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.774+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:59:14.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.790+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T14:59:14.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.810+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:59:14.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.826+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T14:59:14.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.830+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:59:14.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.850+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:59:14.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.854+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:59:14.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.874+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:59:14.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.878+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:59:14.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.926+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:59:14.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.934+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:59:14.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.954+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:59:14.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.962+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:14.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.982+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:59:14.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:14.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:59:15.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.026+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:59:15.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:59:15.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.050+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:59:15.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.054+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:59:15.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.070+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:59:15.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.078+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:59:15.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.086+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T14:59:15.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.122+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:15.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.150+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:59:15.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.150+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:59:15.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.154+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:59:15.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.170+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:59:15.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.182+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:59:15.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.198+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:59:15.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.214+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:59:15.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:59:15.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.290+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:15.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.302+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T14:59:15.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.314+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:59:15.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.330+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:59:15.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.358+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:59:15.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T14:59:15.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 137 16 1496544 1496528 682.662 685.312 0.00347979 0.00145501 2024-09-16T14:59:15.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.366+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:59:15.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.386+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:59:15.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.386+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:59:15.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.426+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:59:15.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.446+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:59:15.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:59:15.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.454+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:59:15.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.470+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T14:59:15.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.482+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:15.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.482+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:59:15.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:15.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.490+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:15.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.498+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:59:15.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.566+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:59:15.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.570+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:59:15.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.574+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:15.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.582+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:59:15.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.586+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:59:15.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.586+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:59:15.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.610+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:59:15.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.622+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:15.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.642+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:59:15.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.642+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:59:15.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.646+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:59:15.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.674+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:59:15.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.694+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:59:15.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.706+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:15.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:59:15.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.734+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T14:59:15.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:59:15.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.774+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:59:15.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.778+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:59:15.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.790+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:59:15.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.794+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T14:59:15.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.802+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:59:15.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.814+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:59:15.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.822+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:59:15.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.846+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:59:15.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.858+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:59:15.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.862+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:59:15.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:59:15.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.890+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:15.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.906+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:15.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.930+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:59:15.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.962+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T14:59:15.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.978+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T14:59:15.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.982+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T14:59:15.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:15.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:59:16.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:59:16.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.010+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:59:16.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.038+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:16.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.066+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:59:16.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.078+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:59:16.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.090+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T14:59:16.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.102+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:59:16.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.110+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:59:16.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.110+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:16.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.114+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:16.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.150+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:59:16.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.162+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:59:16.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.162+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:59:16.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.182+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:59:16.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.198+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:59:16.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.206+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T14:59:16.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.246+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:59:16.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.246+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:59:16.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.258+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:59:16.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.274+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:59:16.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.318+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:59:16.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.322+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:59:16.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.338+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:59:16.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.338+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:59:16.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.362+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:59:16.367 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 138 15 1507624 1507609 682.734 692.562 0.000650562 0.00145483 2024-09-16T14:59:16.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.370+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:59:16.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.382+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:59:16.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.410+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:59:16.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.430+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:59:16.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:59:16.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.442+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:59:16.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.474+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T14:59:16.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.486+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T14:59:16.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.518+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:59:16.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.522+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:59:16.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.526+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:59:16.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.526+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:16.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.550+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:59:16.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:59:16.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.586+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:59:16.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.590+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:59:16.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.626+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:59:16.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.630+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:59:16.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.634+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:59:16.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.646+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:59:16.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.646+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:59:16.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.662+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:59:16.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.674+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:59:16.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.682+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:16.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.718+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T14:59:16.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.738+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:16.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.758+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:59:16.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.762+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:59:16.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:16.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.794+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:59:16.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.798+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:59:16.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.806+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:59:16.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.810+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:59:16.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.838+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T14:59:16.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.846+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T14:59:16.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.858+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:59:16.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.870+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:16.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.878+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:16.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.922+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:59:16.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.938+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:59:16.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.966+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:16.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.970+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:59:16.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:16.994+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:59:17.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.006+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T14:59:17.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.010+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:59:17.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.018+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:59:17.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.022+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T14:59:17.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.026+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T14:59:17.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:59:17.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.054+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:59:17.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.070+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:59:17.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.102+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:59:17.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.134+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T14:59:17.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.142+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:59:17.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.154+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:59:17.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.154+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:59:17.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.170+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:59:17.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.182+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:17.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.218+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:59:17.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.222+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:59:17.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.238+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:59:17.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.254+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:59:17.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.290+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:59:17.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.290+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:17.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.310+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:59:17.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.318+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:17.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.326+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:59:17.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.330+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:59:17.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.350+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:59:17.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 139 16 1518737 1518721 682.818 694.5 0.00160562 0.00145466 2024-09-16T14:59:17.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.390+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:59:17.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.398+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:59:17.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.406+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:17.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.418+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:59:17.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.442+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:59:17.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.466+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:59:17.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.478+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:59:17.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.482+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:59:17.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.486+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:17.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.514+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:59:17.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.530+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:17.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:59:17.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.558+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:17.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.562+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:59:17.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.594+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:59:17.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.598+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:59:17.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.606+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:59:17.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.614+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:59:17.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.618+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:59:17.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.650+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:59:17.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.670+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T14:59:17.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.682+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:59:17.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.690+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:59:17.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.706+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:59:17.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.730+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:59:17.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.758+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:59:17.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.770+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:59:17.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.774+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T14:59:17.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:59:17.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.786+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:59:17.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.798+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:59:17.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.798+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:59:17.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.830+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T14:59:17.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.834+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:17.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.862+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:59:17.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.898+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:59:17.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.898+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T14:59:17.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.910+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:59:17.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.910+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:59:17.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.958+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:59:17.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.970+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:59:17.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.998+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:59:18.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:17.998+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:18.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.014+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T14:59:18.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.030+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:59:18.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.046+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:59:18.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.046+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:59:18.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.054+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:18.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.062+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:59:18.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.066+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T14:59:18.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.094+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:59:18.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.102+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:59:18.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.114+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:18.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.126+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T14:59:18.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.158+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:59:18.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:59:18.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.162+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:59:18.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.198+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:18.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.202+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:59:18.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.214+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:59:18.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.226+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:18.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.238+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T14:59:18.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.266+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:59:18.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.286+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:18.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.294+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T14:59:18.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.318+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:59:18.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.334+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:59:18.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.342+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:59:18.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.350+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:59:18.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:59:18.367860+0000 min lat: 0.000220975 max lat: 0.16813 avg lat: 0.00145453 2024-09-16T14:59:18.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:59:18.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 140 16 1529811 1529795 682.884 692.125 0.00158548 0.00145453 2024-09-16T14:59:18.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.378+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:59:18.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.386+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T14:59:18.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.394+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:59:18.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.402+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:59:18.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.410+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:59:18.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.414+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:59:18.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.430+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:59:18.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.438+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:59:18.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:59:18.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.462+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:59:18.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.478+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:18.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.498+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:59:18.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.510+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:59:18.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.534+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:59:18.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.538+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:59:18.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.554+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:59:18.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.590+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:59:18.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.590+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:59:18.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.590+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:59:18.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.606+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T14:59:18.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.618+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:59:18.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.646+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T14:59:18.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.658+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:59:18.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.658+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:59:18.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.674+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:59:18.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.674+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:59:18.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.714+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:59:18.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.714+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:59:18.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.722+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:59:18.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.730+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:59:18.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.754+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:59:18.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.758+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:59:18.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.782+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:59:18.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.794+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:59:18.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.834+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:59:18.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.854+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:59:18.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.854+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:59:18.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.854+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:59:18.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.858+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T14:59:18.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:59:18.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.914+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:59:18.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.930+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:59:18.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.966+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:59:18.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:18.986+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:19.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.006+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:59:19.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.026+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:59:19.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.034+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:59:19.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.038+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T14:59:19.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.050+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:59:19.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.054+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T14:59:19.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.074+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:59:19.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.114+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:59:19.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.126+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T14:59:19.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.150+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:59:19.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.166+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:59:19.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.186+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T14:59:19.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.202+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:19.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.214+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:59:19.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.242+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:59:19.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:59:19.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.246+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:59:19.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.270+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T14:59:19.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.298+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:59:19.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.334+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:59:19.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.338+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:59:19.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.354+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:59:19.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 141 16 1541032 1541016 683.014 701.312 0.000771358 0.00145426 2024-09-16T14:59:19.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.378+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T14:59:19.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.394+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:59:19.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.402+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:59:19.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.406+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:59:19.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.410+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:19.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.414+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:59:19.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.446+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:59:19.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.458+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:19.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.478+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:59:19.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.486+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:59:19.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.622+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:59:19.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.662+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:59:19.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.682+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:59:19.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.690+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:19.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.718+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:19.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.730+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:59:19.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.738+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:59:19.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.738+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T14:59:19.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.754+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:59:19.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:59:19.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.786+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:59:19.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.794+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:59:19.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.838+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:59:19.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.870+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:19.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.870+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T14:59:19.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.878+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:59:19.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.898+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:59:19.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.906+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:59:19.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.910+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:59:19.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.930+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:59:19.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.938+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:59:19.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.958+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:59:19.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.966+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:59:19.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:19.982+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:59:20.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.006+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T14:59:20.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.014+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:59:20.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.014+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:59:20.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.022+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:20.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.066+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:59:20.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.070+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:59:20.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.074+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T14:59:20.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.094+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:59:20.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.102+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:59:20.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.114+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:59:20.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.150+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:59:20.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.158+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:59:20.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.170+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:59:20.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:59:20.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.182+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:59:20.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.218+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T14:59:20.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:20.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.246+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:59:20.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.258+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:59:20.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.306+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:59:20.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.334+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:59:20.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 142 16 1550257 1550241 682.264 576.562 0.000973518 0.00145588 2024-09-16T14:59:20.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.378+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:59:20.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.390+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T14:59:20.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.394+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:59:20.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:59:20.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.414+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:59:20.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T14:59:20.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.446+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T14:59:20.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.454+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:59:20.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.454+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:59:20.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.474+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:59:20.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.478+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:59:20.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.486+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:59:20.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:59:20.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.526+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:59:20.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.526+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:59:20.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.534+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:59:20.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.550+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T14:59:20.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.566+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T14:59:20.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.566+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:59:20.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.606+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:59:20.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.614+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:59:20.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.618+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:59:20.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.626+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:59:20.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.638+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:59:20.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.650+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T14:59:20.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.706+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T14:59:20.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.710+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T14:59:20.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:20.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.754+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:59:20.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.758+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:59:20.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.782+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:59:20.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.790+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:20.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.794+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T14:59:20.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.802+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T14:59:20.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.862+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:59:20.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.878+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:59:20.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.882+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:59:20.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.886+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T14:59:20.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.898+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:59:20.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.906+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:59:20.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.942+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T14:59:20.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:59:20.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.966+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:59:20.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.990+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:20.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.994+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:59:20.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:20.994+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:59:21.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.030+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T14:59:21.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:59:21.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.066+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T14:59:21.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.098+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T14:59:21.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.102+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T14:59:21.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.142+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:21.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.170+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T14:59:21.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.198+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:59:21.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.222+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:59:21.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T14:59:21.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.278+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:59:21.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.282+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:59:21.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.286+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:59:21.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.298+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:59:21.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.306+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:59:21.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.342+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:59:21.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.358+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:59:21.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.358+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:59:21.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 143 16 1560841 1560825 682.119 661.5 0.00157296 0.00145618 2024-09-16T14:59:21.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.390+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:59:21.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.394+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:59:21.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.414+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:59:21.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.422+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:59:21.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.438+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:59:21.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.446+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:59:21.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.478+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:59:21.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.490+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:59:21.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.498+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:59:21.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.502+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:21.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.514+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:59:21.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.542+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T14:59:21.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.550+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:59:21.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.578+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:59:21.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.586+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:59:21.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.590+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:59:21.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.598+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:59:21.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.610+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:59:21.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.614+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T14:59:21.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.642+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:59:21.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.642+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:59:21.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.658+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T14:59:21.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.674+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:59:21.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.714+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:59:21.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:59:21.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.734+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T14:59:21.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.746+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:59:21.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.750+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:59:21.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.750+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:59:21.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.770+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:21.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.806+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:59:21.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.810+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:59:21.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.826+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:59:21.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.826+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:59:21.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:59:21.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.862+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:59:21.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.894+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:59:21.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.898+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:59:21.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.902+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:59:21.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.914+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:21.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.950+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:59:21.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.970+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T14:59:21.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.974+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:59:21.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:21.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:59:22.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.002+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:22.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.014+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:59:22.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:22.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.050+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:59:22.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.098+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:59:22.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.110+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:59:22.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.126+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:59:22.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.130+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:59:22.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.146+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:59:22.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.166+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:22.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.166+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T14:59:22.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.170+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:59:22.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.198+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:59:22.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.218+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:22.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.238+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:22.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.250+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:59:22.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.302+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:59:22.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.306+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:22.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.322+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:59:22.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.326+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:59:22.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.338+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T14:59:22.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.354+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:59:22.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 144 16 1572030 1572014 682.238 699.312 0.00062553 0.00145592 2024-09-16T14:59:22.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.370+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:59:22.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.382+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:59:22.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.402+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T14:59:22.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.406+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:59:22.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.410+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:59:22.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.426+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:59:22.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.442+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:59:22.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.446+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:59:22.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.458+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T14:59:22.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.470+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:59:22.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.486+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:59:22.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.494+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:59:22.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.514+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:59:22.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.534+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T14:59:22.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.534+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T14:59:22.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.562+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:59:22.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.574+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:59:22.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.586+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T14:59:22.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.606+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:59:22.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.610+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:59:22.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.618+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:59:22.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.646+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:59:22.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.650+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:59:22.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.662+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:22.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.674+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:59:22.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.678+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:59:22.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.706+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T14:59:22.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.710+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T14:59:22.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.730+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:22.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.766+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:22.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.774+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:22.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.802+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T14:59:22.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.806+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:59:22.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.826+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T14:59:22.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.830+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:59:22.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.862+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:22.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.878+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:59:22.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.898+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:22.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.922+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T14:59:22.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.930+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:59:22.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.934+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:22.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.934+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T14:59:22.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.982+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:59:22.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:22.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:59:23.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.006+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:59:23.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.062+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:23.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.074+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:59:23.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.078+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:59:23.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.086+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:59:23.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.090+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:59:23.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.102+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:59:23.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.114+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:23.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.134+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:59:23.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.150+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:59:23.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:59:23.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.174+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:59:23.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.190+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:59:23.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.242+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:59:23.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.258+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:59:23.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.270+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:59:23.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.286+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:23.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.302+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:59:23.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.306+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T14:59:23.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.326+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:59:23.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.342+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:59:23.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.358+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:59:23.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 145 15 1582870 1582855 682.205 677.562 0.00119925 0.001456 2024-09-16T14:59:23.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.374+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:59:23.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.374+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:59:23.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.394+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:59:23.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.398+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:59:23.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.410+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:59:23.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.422+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:59:23.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.430+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:59:23.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.430+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:59:23.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.478+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:59:23.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.502+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:59:23.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.502+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:59:23.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.538+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:59:23.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.550+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:59:23.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.554+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:59:23.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.618+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:59:23.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.634+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:59:23.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.650+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:59:23.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.658+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:59:23.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.670+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:59:23.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.698+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T14:59:23.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.726+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T14:59:23.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.746+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:23.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.746+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:59:23.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.758+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:59:23.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.762+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:59:23.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.770+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:23.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.790+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:23.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.798+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:59:23.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.814+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T14:59:23.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.822+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T14:59:23.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.834+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T14:59:23.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.846+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:59:23.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:59:23.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.862+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T14:59:23.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.886+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:59:23.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.902+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:59:23.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.910+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T14:59:23.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.950+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:59:23.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.958+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:59:23.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.958+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:59:23.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:23.982+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T14:59:24.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:59:24.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.042+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:59:24.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.058+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:59:24.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.062+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:59:24.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.106+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:59:24.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.110+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:59:24.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.122+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:59:24.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.122+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:59:24.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.130+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T14:59:24.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.154+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:59:24.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.214+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:24.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.222+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T14:59:24.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.230+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T14:59:24.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.246+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:59:24.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.262+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:59:24.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.270+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:59:24.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.282+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T14:59:24.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.286+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:59:24.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.290+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:59:24.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.306+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:59:24.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.322+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:59:24.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.354+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T14:59:24.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 146 16 1594076 1594060 682.329 700.312 0.00120824 0.00145574 2024-09-16T14:59:24.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.378+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T14:59:24.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.390+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T14:59:24.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.394+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:59:24.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.402+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:24.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.402+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T14:59:24.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.430+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:59:24.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:59:24.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.458+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T14:59:24.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.478+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:59:24.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.494+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:59:24.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.542+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:59:24.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.554+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:59:24.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.566+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:59:24.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.606+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:59:24.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.618+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:59:24.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.622+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T14:59:24.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.650+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:59:24.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.670+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:59:24.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.694+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:59:24.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.698+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:59:24.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.710+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:59:24.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.726+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:59:24.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.738+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:59:24.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.738+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:59:24.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.766+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:59:24.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.774+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:59:24.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.806+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:59:24.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.822+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T14:59:24.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.846+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:59:24.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.846+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:59:24.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.850+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T14:59:24.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.858+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:59:24.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.870+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:59:24.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.906+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:59:24.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.926+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:59:24.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.946+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:59:24.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.958+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:59:24.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.962+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T14:59:24.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.974+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T14:59:24.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:24.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:59:25.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.002+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:59:25.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.022+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:59:25.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.038+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T14:59:25.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.082+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:59:25.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.094+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T14:59:25.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.098+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:59:25.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.106+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:59:25.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.118+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:59:25.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.138+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:59:25.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.146+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T14:59:25.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.146+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T14:59:25.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.158+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:59:25.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.186+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:59:25.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.186+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:59:25.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.222+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:59:25.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.226+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:25.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.258+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:59:25.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.270+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:25.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.270+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:59:25.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.322+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:59:25.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.326+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:59:25.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.354+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:59:25.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.354+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:59:25.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 147 16 1604429 1604413 682.088 647.062 0.00117513 0.00145625 2024-09-16T14:59:25.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T14:59:25.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.390+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T14:59:25.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.410+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:59:25.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.442+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T14:59:25.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.478+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:59:25.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.494+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:59:25.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.494+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:59:25.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.530+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T14:59:25.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.538+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:59:25.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.558+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T14:59:25.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.566+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:59:25.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.574+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T14:59:25.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.582+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T14:59:25.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.590+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T14:59:25.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.590+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:25.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.626+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T14:59:25.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T14:59:25.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.650+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T14:59:25.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.678+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T14:59:25.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.694+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:59:25.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.702+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T14:59:25.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.706+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:59:25.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.734+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:25.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.758+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:59:25.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.770+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:59:25.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.778+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T14:59:25.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.782+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:59:25.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.794+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:59:25.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.830+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:59:25.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.834+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:59:25.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.846+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:59:25.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.858+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:25.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.858+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:59:25.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.874+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T14:59:25.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.906+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:59:25.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.910+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:59:25.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.942+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:25.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.942+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:59:25.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.970+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:59:25.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:25.978+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T14:59:26.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.006+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:59:26.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.010+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T14:59:26.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.014+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:59:26.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.042+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:59:26.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.126+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T14:59:26.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.158+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:59:26.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:59:26.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.158+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:59:26.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.166+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:59:26.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.170+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:59:26.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.210+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:59:26.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.230+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T14:59:26.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.234+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:59:26.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.258+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:59:26.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.266+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T14:59:26.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.270+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:59:26.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.314+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T14:59:26.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.334+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:59:26.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.354+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:59:26.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.366+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:59:26.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 148 16 1615127 1615111 681.997 668.625 0.000838164 0.00145645 2024-09-16T14:59:26.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.378+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:59:26.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.386+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:26.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.394+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:26.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.406+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:59:26.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.430+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T14:59:26.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.454+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:59:26.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.474+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T14:59:26.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:59:26.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.498+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T14:59:26.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.498+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:26.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.514+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:59:26.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.522+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T14:59:26.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.534+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:59:26.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.542+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:59:26.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.594+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:59:26.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.618+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:59:26.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.618+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:59:26.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.638+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:59:26.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.646+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:59:26.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.650+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:59:26.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.662+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T14:59:26.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.666+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:59:26.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.666+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:26.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.678+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:59:26.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.718+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:26.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.734+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:59:26.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.746+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T14:59:26.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.766+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:59:26.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.770+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:59:26.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.782+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:59:26.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.794+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T14:59:26.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.798+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:59:26.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.842+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:26.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.858+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:59:26.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.878+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:59:26.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:59:26.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.902+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:59:26.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.902+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:59:26.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.926+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T14:59:26.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.934+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T14:59:26.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.966+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:59:26.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.982+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:26.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:26.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:59:27.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.002+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T14:59:27.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.022+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:59:27.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.026+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:59:27.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:59:27.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.050+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:59:27.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.070+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T14:59:27.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.082+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:59:27.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.118+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T14:59:27.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.122+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:59:27.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.158+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T14:59:27.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.158+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:27.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.174+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:59:27.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.194+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:59:27.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.198+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:59:27.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.198+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:59:27.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.198+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T14:59:27.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.222+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:59:27.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.230+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T14:59:27.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.234+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:59:27.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.262+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:59:27.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.270+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T14:59:27.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.290+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T14:59:27.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.322+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:59:27.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.334+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:59:27.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.338+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:59:27.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.350+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:27.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 149 16 1626089 1626073 682.018 685.125 0.00075869 0.0014564 2024-09-16T14:59:27.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.374+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:59:27.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.378+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:59:27.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.394+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T14:59:27.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.398+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:59:27.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.402+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T14:59:27.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.418+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T14:59:27.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.434+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:59:27.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.438+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:59:27.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.454+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:59:27.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.502+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:59:27.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.506+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:59:27.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.522+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:59:27.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.526+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:59:27.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.526+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:27.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.546+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:59:27.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.558+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:27.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.574+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:59:27.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.590+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:59:27.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.626+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:59:27.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.630+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:59:27.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:59:27.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.654+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:59:27.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.666+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:59:27.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.694+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T14:59:27.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.710+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:59:27.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.726+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:27.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.726+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:59:27.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:59:27.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.738+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T14:59:27.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.766+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T14:59:27.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.778+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:59:27.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.798+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:59:27.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:59:27.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.822+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:59:27.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.830+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T14:59:27.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.846+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:59:27.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.850+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:59:27.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.882+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T14:59:27.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.890+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:59:27.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.898+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:59:27.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.906+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T14:59:27.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.914+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:27.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.922+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:59:27.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.934+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:59:27.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.950+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T14:59:27.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.974+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:59:27.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:27.990+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:59:28.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.006+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T14:59:28.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.010+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:59:28.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.010+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:59:28.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.034+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:59:28.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.046+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T14:59:28.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.046+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:59:28.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.070+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:59:28.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.106+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:59:28.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.106+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T14:59:28.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.134+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:59:28.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.142+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:59:28.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.150+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:59:28.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.178+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T14:59:28.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.178+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T14:59:28.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.182+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T14:59:28.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.186+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T14:59:28.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.190+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T14:59:28.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.218+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:59:28.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.222+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:59:28.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.258+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:59:28.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:59:28.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.294+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T14:59:28.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.298+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T14:59:28.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.298+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:59:28.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.322+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:59:28.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.322+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:59:28.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.346+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:59:28.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 150 16 1637064 1637048 682.043 685.938 0.00371933 0.00145634 2024-09-16T14:59:28.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.370+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:59:28.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.378+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:59:28.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.386+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:28.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.398+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:59:28.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.434+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:28.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.438+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T14:59:28.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:59:28.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.474+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:59:28.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.490+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T14:59:28.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.490+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T14:59:28.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.510+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:59:28.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.522+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:59:28.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T14:59:28.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.558+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:28.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.558+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T14:59:28.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.578+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:59:28.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.602+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:59:28.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.606+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T14:59:28.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.618+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T14:59:28.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.622+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T14:59:28.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.630+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:59:28.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.642+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T14:59:28.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.650+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:28.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.654+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:59:28.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.674+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:59:28.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.682+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:59:28.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.706+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:59:28.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.726+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:59:28.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.750+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:59:28.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.770+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:59:28.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.770+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:59:28.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.794+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:59:28.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.802+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:59:28.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.806+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:59:28.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.810+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:59:28.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.830+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T14:59:28.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.838+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:59:28.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.862+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:59:28.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.866+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T14:59:28.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.878+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:59:28.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.878+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:59:28.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.882+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:59:28.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.906+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:28.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.934+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T14:59:28.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.946+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:59:28.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.946+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:59:28.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.958+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:59:28.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:28.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T14:59:29.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.002+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:59:29.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.006+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:59:29.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.014+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T14:59:29.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.034+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:59:29.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.058+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:59:29.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.058+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:29.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.078+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T14:59:29.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.082+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:59:29.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.090+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:29.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.114+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:59:29.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.118+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:29.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.126+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:29.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.146+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:59:29.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:59:29.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.182+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:59:29.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.186+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:59:29.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.190+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:59:29.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:59:29.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.250+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T14:59:29.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.262+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T14:59:29.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.270+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:59:29.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.278+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T14:59:29.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.298+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:59:29.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.318+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:59:29.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.318+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T14:59:29.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.326+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:59:29.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.326+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:59:29.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.342+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:59:29.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.362+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T14:59:29.368 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 151 15 1647949 1647934 682.032 680.375 0.00113405 0.00145637 2024-09-16T14:59:29.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.398+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T14:59:29.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.398+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T14:59:29.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T14:59:29.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.398+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:59:29.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.426+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:59:29.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.442+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:59:29.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.474+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:59:29.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.478+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:59:29.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.494+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:29.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.506+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T14:59:29.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.526+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T14:59:29.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.530+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:59:29.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.530+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T14:59:29.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.542+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:59:29.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.554+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T14:59:29.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.586+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:59:29.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.594+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:59:29.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.598+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:29.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.622+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:59:29.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.626+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:59:29.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.630+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:59:29.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.654+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:59:29.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.690+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T14:59:29.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.694+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:59:29.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.706+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:59:29.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.714+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T14:59:29.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.742+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:59:29.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.758+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:59:29.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.766+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:59:29.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.770+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T14:59:29.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.782+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:59:29.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.798+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:59:29.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.806+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:59:29.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.846+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:59:29.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.858+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T14:59:29.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.862+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:59:29.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.862+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:29.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.866+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:59:29.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.878+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:59:29.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.898+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T14:59:29.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.914+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:59:29.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.918+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:59:29.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.922+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:59:29.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.974+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T14:59:29.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.986+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T14:59:30.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:29.998+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:59:30.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.022+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:59:30.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.026+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:30.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.026+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:59:30.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.042+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:59:30.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.046+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T14:59:30.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.058+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:59:30.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.090+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:59:30.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.098+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:59:30.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.110+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T14:59:30.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.114+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:59:30.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.138+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:30.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.162+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:59:30.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.170+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:59:30.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.178+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T14:59:30.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.182+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:59:30.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.198+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:59:30.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.230+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T14:59:30.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.246+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T14:59:30.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T14:59:30.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.278+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:30.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.286+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:59:30.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:59:30.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.302+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:59:30.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.326+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T14:59:30.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.338+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T14:59:30.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.346+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:59:30.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 152 16 1658893 1658877 682.044 683.938 0.000849228 0.00145636 2024-09-16T14:59:30.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.370+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:59:30.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.374+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:59:30.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.382+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:59:30.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.394+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:59:30.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.430+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:59:30.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.430+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:30.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.438+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:59:30.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.454+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:59:30.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.466+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:59:30.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.490+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:59:30.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.494+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T14:59:30.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.506+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T14:59:30.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.522+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T14:59:30.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.533+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:30.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.549+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T14:59:30.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.557+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:59:30.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.573+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:59:30.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.589+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:59:30.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:59:30.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.617+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:59:30.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.633+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:59:30.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.641+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T14:59:30.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.645+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:59:30.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.661+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:59:30.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.673+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:59:30.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.701+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:59:30.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.705+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:59:30.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.709+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:59:30.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.713+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:59:30.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.733+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:59:30.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.765+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:59:30.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.773+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T14:59:30.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.781+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:59:30.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.809+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:59:30.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.821+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:59:30.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.829+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:59:30.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.833+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:30.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.857+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:59:30.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.885+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:59:30.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.893+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:59:30.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.921+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:59:30.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.929+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T14:59:30.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.933+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T14:59:30.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.945+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:59:30.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.961+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:59:30.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:59:30.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:30.997+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T14:59:31.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.009+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:59:31.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.013+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T14:59:31.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.025+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T14:59:31.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.029+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:31.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.101+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:59:31.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.113+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:59:31.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.117+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T14:59:31.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.125+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T14:59:31.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.129+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:59:31.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.129+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:59:31.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.161+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:59:31.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.161+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:59:31.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.185+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T14:59:31.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.197+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:59:31.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.221+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:59:31.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.253+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T14:59:31.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.261+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:31.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.269+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:59:31.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.285+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T14:59:31.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.285+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T14:59:31.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.317+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:59:31.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.317+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:59:31.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.325+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:59:31.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.345+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:59:31.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.361+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:31.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 153 16 1669573 1669557 681.949 667.5 0.000791258 0.00145655 2024-09-16T14:59:31.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.377+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:59:31.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.397+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:31.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.397+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:59:31.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.421+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:31.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.433+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T14:59:31.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.449+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T14:59:31.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.465+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:59:31.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.497+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T14:59:31.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.509+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:59:31.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:59:31.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.537+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:59:31.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.545+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T14:59:31.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.549+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:59:31.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.561+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T14:59:31.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.573+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:59:31.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.577+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T14:59:31.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.609+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T14:59:31.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.621+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T14:59:31.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.637+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:59:31.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.641+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:31.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.653+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:59:31.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.665+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:59:31.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:31.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.717+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:59:31.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.725+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T14:59:31.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.733+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T14:59:31.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.745+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:31.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.749+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T14:59:31.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.761+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:59:31.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.801+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:59:31.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.801+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:59:31.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.829+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:59:31.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.853+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:59:31.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.853+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:59:31.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.861+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:59:31.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.877+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T14:59:31.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.885+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:59:31.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.909+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:59:31.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.909+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:31.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.913+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:59:31.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.937+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:59:31.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.937+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:59:31.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.941+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:59:31.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.961+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T14:59:31.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.969+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:59:31.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:31.993+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T14:59:32.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.013+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:59:32.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.025+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:59:32.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.037+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T14:59:32.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.049+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:59:32.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.049+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T14:59:32.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.077+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:59:32.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.085+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:59:32.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.089+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:59:32.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.093+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:59:32.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.121+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T14:59:32.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.125+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:32.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.133+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T14:59:32.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.141+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:32.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.145+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:59:32.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.153+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:59:32.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.177+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T14:59:32.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.185+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:59:32.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.221+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T14:59:32.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.233+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T14:59:32.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.245+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:32.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.257+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:59:32.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.257+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T14:59:32.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.265+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:59:32.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.273+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:59:32.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.293+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:59:32.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.317+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:59:32.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.333+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T14:59:32.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.333+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:59:32.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.333+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:59:32.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.341+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T14:59:32.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.357+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:59:32.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 154 16 1680513 1680497 681.96 683.75 0.000505184 0.00145648 2024-09-16T14:59:32.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.369+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T14:59:32.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.377+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:59:32.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.381+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:59:32.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.389+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:59:32.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:59:32.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.409+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:59:32.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.437+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:59:32.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.445+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:59:32.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.465+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:59:32.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.481+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:59:32.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.481+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:59:32.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.509+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:32.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.513+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:59:32.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.517+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T14:59:32.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.529+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:59:32.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.557+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:32.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.565+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:59:32.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.589+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:32.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:32.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.609+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T14:59:32.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.641+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:59:32.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.641+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T14:59:32.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.665+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:59:32.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.665+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:59:32.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.673+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:32.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.693+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T14:59:32.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.701+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:32.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.701+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:59:32.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.717+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:59:32.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.749+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:59:32.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.753+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:59:32.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.769+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:59:32.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.777+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:32.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.781+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:32.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.801+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T14:59:32.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.813+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:32.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.817+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:59:32.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.829+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:59:32.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.849+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T14:59:32.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.857+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T14:59:32.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.865+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:59:32.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.881+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:59:32.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.889+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:59:32.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.925+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:59:32.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.941+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T14:59:32.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.961+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:59:32.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.981+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:59:32.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.981+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T14:59:32.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:32.989+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T14:59:33.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.001+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:59:33.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.009+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T14:59:33.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.025+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:59:33.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.041+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:59:33.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.065+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:59:33.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.081+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T14:59:33.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.097+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:59:33.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.097+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:59:33.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.121+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T14:59:33.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.129+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T14:59:33.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.137+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:59:33.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.181+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:59:33.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.189+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T14:59:33.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.225+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:59:33.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.245+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:59:33.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.245+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:59:33.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.265+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:59:33.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.285+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:59:33.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.289+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:59:33.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.301+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:33.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.309+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T14:59:33.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.321+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:59:33.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.349+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T14:59:33.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 155 16 1691534 1691518 682.004 688.812 0.00123845 0.00145643 2024-09-16T14:59:33.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.373+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:59:33.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.373+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:59:33.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.381+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T14:59:33.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.393+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:59:33.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.417+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:33.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.465+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:59:33.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.469+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T14:59:33.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.505+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:59:33.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.505+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T14:59:33.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.537+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:59:33.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.553+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:59:33.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.557+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:59:33.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.565+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:59:33.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.577+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T14:59:33.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.581+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:59:33.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.589+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:59:33.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.621+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:33.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.621+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:59:33.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.633+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:59:33.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.665+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T14:59:33.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.665+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:59:33.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.681+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:59:33.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.693+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:59:33.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.697+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:59:33.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.733+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T14:59:33.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.741+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:59:33.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.761+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:59:33.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.765+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:59:33.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.785+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:59:33.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.813+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:59:33.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.833+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:59:33.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.845+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:59:33.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.849+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T14:59:33.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.877+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:59:33.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.881+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:33.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.881+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:59:33.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.913+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T14:59:33.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.921+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T14:59:33.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.933+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:59:33.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.937+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T14:59:33.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.941+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:59:33.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.945+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:33.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.977+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:59:33.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:33.989+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:59:34.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.017+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T14:59:34.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.029+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:59:34.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.033+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:59:34.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.049+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:34.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.077+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T14:59:34.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.093+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:59:34.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.117+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T14:59:34.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.129+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T14:59:34.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.137+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T14:59:34.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.165+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:34.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.197+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T14:59:34.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.217+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:59:34.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.221+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:59:34.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.221+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:59:34.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.229+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T14:59:34.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.237+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:59:34.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.261+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:59:34.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.277+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:59:34.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.309+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:59:34.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.321+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T14:59:34.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.329+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T14:59:34.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.333+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:59:34.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.337+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T14:59:34.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.349+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:59:34.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 156 16 1702732 1702716 682.118 699.875 0.000830761 0.00145615 2024-09-16T14:59:34.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.365+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T14:59:34.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.409+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:59:34.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.429+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:59:34.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.429+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T14:59:34.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.429+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:59:34.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.461+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:59:34.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.465+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:59:34.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.469+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T14:59:34.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.477+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:59:34.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.489+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:59:34.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.561+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T14:59:34.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.597+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:59:34.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.605+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:59:34.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.613+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:59:34.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.617+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:59:34.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.653+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T14:59:34.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.657+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T14:59:34.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.669+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T14:59:34.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.697+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:59:34.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.701+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:59:34.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.709+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T14:59:34.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.761+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:59:34.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.769+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:59:34.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.781+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:59:34.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.809+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:34.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.813+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:59:34.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.821+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:59:34.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.849+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:59:34.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.869+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:59:34.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.889+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:59:34.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.893+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:59:34.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.917+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:59:34.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.921+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:59:34.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.937+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:59:34.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.941+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T14:59:34.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.953+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:59:34.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.973+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:34.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:34.977+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T14:59:35.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.009+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:35.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.009+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:59:35.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.021+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:59:35.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.037+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T14:59:35.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.049+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:35.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.069+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:59:35.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.093+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:35.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:59:35.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.117+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:59:35.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.133+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T14:59:35.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.137+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:59:35.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.141+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T14:59:35.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.157+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T14:59:35.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.177+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T14:59:35.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.193+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T14:59:35.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.197+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T14:59:35.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.225+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:59:35.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.261+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:59:35.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.261+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T14:59:35.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.261+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T14:59:35.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.309+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:35.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.325+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:59:35.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.333+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:35.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.357+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:59:35.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 157 16 1713181 1713165 681.933 653.062 0.00122065 0.00145659 2024-09-16T14:59:35.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.381+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T14:59:35.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.405+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:59:35.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.405+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:59:35.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.421+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T14:59:35.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.453+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T14:59:35.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.457+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:59:35.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.473+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:59:35.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.513+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T14:59:35.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.529+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:59:35.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.553+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:59:35.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.585+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:59:35.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.613+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:35.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T14:59:35.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T14:59:35.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.665+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T14:59:35.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.673+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:59:35.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.673+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T14:59:35.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.681+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:59:35.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.685+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T14:59:35.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.709+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T14:59:35.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.725+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:59:35.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.729+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T14:59:35.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.765+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T14:59:35.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.773+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T14:59:35.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.773+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T14:59:35.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.789+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T14:59:35.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.809+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:59:35.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.817+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:59:35.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.825+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:59:35.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.841+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:59:35.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.845+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T14:59:35.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.849+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:35.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.861+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:59:35.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.873+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T14:59:35.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.905+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:59:35.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.905+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:59:35.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.933+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:59:35.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.945+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:59:35.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.949+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:59:35.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.961+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:35.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.977+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:59:35.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:35.981+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T14:59:36.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.001+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:59:36.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.005+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T14:59:36.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.029+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:59:36.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.037+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:59:36.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.061+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:59:36.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.077+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:59:36.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.077+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:59:36.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.113+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:59:36.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.117+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:59:36.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.117+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T14:59:36.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.181+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:59:36.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.189+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:36.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.197+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T14:59:36.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.205+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:59:36.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.209+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T14:59:36.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T14:59:36.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:59:36.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.301+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:59:36.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.301+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T14:59:36.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.325+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T14:59:36.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.333+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T14:59:36.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.361+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T14:59:36.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 158 16 1723924 1723908 681.866 671.438 0.00157772 0.00145673 2024-09-16T14:59:36.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.385+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:59:36.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.385+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T14:59:36.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.393+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:36.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T14:59:36.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.425+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:59:36.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.453+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:59:36.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.465+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:59:36.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.469+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:59:36.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.497+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:59:36.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.501+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:59:36.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.529+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:59:36.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.537+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:59:36.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.549+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T14:59:36.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:59:36.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.565+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:36.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.573+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:59:36.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.605+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T14:59:36.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.621+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:59:36.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.637+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T14:59:36.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.653+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:59:36.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.665+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:59:36.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.685+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T14:59:36.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.709+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T14:59:36.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.721+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:59:36.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.741+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:36.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.761+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:59:36.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.769+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T14:59:36.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.773+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T14:59:36.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:59:36.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.809+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:36.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.813+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:59:36.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.817+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:36.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.837+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:59:36.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.837+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:36.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.869+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T14:59:36.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.897+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:59:36.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.897+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T14:59:36.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.921+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:36.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.929+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T14:59:36.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.961+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T14:59:36.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.965+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:59:36.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:36.977+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:59:37.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.005+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:59:37.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.041+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T14:59:37.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.045+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:59:37.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.073+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T14:59:37.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.089+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T14:59:37.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.105+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:37.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.129+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:59:37.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.133+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:37.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.141+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:59:37.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.149+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:59:37.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.161+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:59:37.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.181+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T14:59:37.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.189+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:59:37.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.189+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:37.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.229+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:59:37.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.229+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:37.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.241+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:59:37.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.249+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:59:37.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.261+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:59:37.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.265+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T14:59:37.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.273+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:37.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.305+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:59:37.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.305+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:59:37.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.321+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T14:59:37.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.353+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T14:59:37.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.353+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T14:59:37.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 159 16 1734951 1734935 681.912 689.188 0.00275423 0.00145661 2024-09-16T14:59:37.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.385+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T14:59:37.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.385+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T14:59:37.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.397+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T14:59:37.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.405+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T14:59:37.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:59:37.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.441+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T14:59:37.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.493+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:37.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.521+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:59:37.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.533+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T14:59:37.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.541+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:59:37.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.565+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T14:59:37.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.573+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:59:37.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.577+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:59:37.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.589+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T14:59:37.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.593+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:37.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.645+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T14:59:37.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.669+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:59:37.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.689+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T14:59:37.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.693+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T14:59:37.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.709+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T14:59:37.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.717+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:59:37.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.721+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:59:37.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.749+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T14:59:37.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.777+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T14:59:37.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.797+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T14:59:37.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.801+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T14:59:37.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.825+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T14:59:37.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.837+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T14:59:37.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.841+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:59:37.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.857+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:59:37.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.873+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:59:37.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.905+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:59:37.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.909+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T14:59:37.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.909+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:59:37.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.925+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:59:37.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.941+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T14:59:37.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.973+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T14:59:37.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:37.985+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:38.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.009+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T14:59:38.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.025+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:38.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.025+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T14:59:38.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.049+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:59:38.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.061+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T14:59:38.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.069+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T14:59:38.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.073+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:59:38.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.113+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:59:38.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.117+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:59:38.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.129+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:38.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.141+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:59:38.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.153+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:38.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.157+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T14:59:38.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.181+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:59:38.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.181+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:59:38.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.201+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T14:59:38.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.217+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:59:38.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.233+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:59:38.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.245+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:38.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T14:59:38.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.257+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:59:38.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.281+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:59:38.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.313+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T14:59:38.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.317+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T14:59:38.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.317+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T14:59:38.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.349+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:59:38.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:59:38.369515+0000 min lat: 0.000220975 max lat: 0.16813 avg lat: 0.00145624 2024-09-16T14:59:38.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:59:38.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 160 16 1746336 1746320 682.097 711.562 0.00117493 0.00145624 2024-09-16T14:59:38.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.369+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:59:38.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.369+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T14:59:38.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.393+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:59:38.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.397+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:38.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.409+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:59:38.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.445+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T14:59:38.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.461+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:59:38.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.477+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:59:38.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.485+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T14:59:38.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.517+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T14:59:38.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.521+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:59:38.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.533+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T14:59:38.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.557+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:59:38.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.573+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T14:59:38.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.589+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:59:38.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T14:59:38.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.601+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:38.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:59:38.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.641+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T14:59:38.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.653+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:59:38.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.673+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T14:59:38.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.677+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T14:59:38.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.677+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:59:38.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.685+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T14:59:38.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.721+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T14:59:38.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.725+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T14:59:38.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.729+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:59:38.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.749+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:59:38.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.777+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:38.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.785+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T14:59:38.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.793+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:59:38.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:59:38.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.809+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:59:38.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.813+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T14:59:38.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.829+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:59:38.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.841+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T14:59:38.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.849+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T14:59:38.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.881+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:38.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.889+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T14:59:38.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.893+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:59:38.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.909+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:59:38.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.925+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T14:59:38.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.929+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:59:38.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.941+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T14:59:38.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.945+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:59:38.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.945+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:59:38.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.985+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:38.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:38.989+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:39.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.001+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:59:39.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.017+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:59:39.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.029+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T14:59:39.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.033+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T14:59:39.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.053+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T14:59:39.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.057+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:59:39.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.069+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:59:39.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.093+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:59:39.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.097+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T14:59:39.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.109+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:59:39.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.113+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:59:39.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.137+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:59:39.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.137+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T14:59:39.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.157+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T14:59:39.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.205+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:59:39.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.249+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:59:39.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:59:39.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.261+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:59:39.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.277+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T14:59:39.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.289+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:59:39.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.305+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:59:39.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.309+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T14:59:39.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.309+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:59:39.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.349+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:39.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 161 16 1757336 1757320 682.13 687.5 0.000708625 0.00145616 2024-09-16T14:59:39.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.377+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T14:59:39.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.393+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:59:39.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.397+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T14:59:39.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.413+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:39.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.425+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:59:39.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.461+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:59:39.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.477+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:39.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.493+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:59:39.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.501+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:59:39.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.537+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:59:39.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.541+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:59:39.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.557+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:59:39.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.565+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T14:59:39.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.585+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:59:39.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.585+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:59:39.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.613+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T14:59:39.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.625+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:59:39.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.629+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:59:39.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.645+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T14:59:39.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.657+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:59:39.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.669+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T14:59:39.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.669+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T14:59:39.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.681+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T14:59:39.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.701+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:59:39.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.709+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:59:39.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.729+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:39.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.733+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T14:59:39.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.733+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:39.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.797+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:59:39.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.797+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:39.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.809+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:59:39.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.817+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:59:39.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.837+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:59:39.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.865+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T14:59:39.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.889+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:59:39.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.893+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:59:39.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.909+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T14:59:39.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.925+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:59:39.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.929+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:59:39.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.937+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:59:39.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.957+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T14:59:39.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.957+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T14:59:39.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:39.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T14:59:40.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.017+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:59:40.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.021+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:59:40.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.029+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:40.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.037+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:59:40.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.065+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:59:40.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.089+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T14:59:40.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.093+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:59:40.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.117+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:59:40.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.121+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T14:59:40.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.153+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T14:59:40.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.153+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:59:40.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.161+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:59:40.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.181+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:59:40.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.197+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T14:59:40.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.205+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T14:59:40.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.209+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:59:40.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.225+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:59:40.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.241+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:59:40.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.253+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:59:40.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.273+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T14:59:40.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.281+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:59:40.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.289+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:59:40.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.293+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:59:40.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.317+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T14:59:40.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.321+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:40.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.329+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T14:59:40.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.345+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:59:40.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.361+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:59:40.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.365+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:59:40.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 162 15 1768727 1768712 682.314 712 0.000735248 0.00145576 2024-09-16T14:59:40.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.385+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:59:40.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.389+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:59:40.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.413+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T14:59:40.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.433+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:59:40.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.441+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:59:40.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.453+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:59:40.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.473+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T14:59:40.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.473+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T14:59:40.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.485+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T14:59:40.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.517+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T14:59:40.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.521+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T14:59:40.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.529+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:59:40.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.557+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:59:40.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.557+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T14:59:40.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.561+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:59:40.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.561+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:59:40.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.589+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T14:59:40.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T14:59:40.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.629+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:59:40.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T14:59:40.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.645+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T14:59:40.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.665+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:59:40.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.693+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T14:59:40.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.697+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:40.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.709+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:59:40.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.713+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:59:40.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.753+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T14:59:40.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.785+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:59:40.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.817+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:59:40.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.825+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:59:40.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.849+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:40.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.857+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T14:59:40.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.861+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T14:59:40.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.881+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:59:40.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.897+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:59:40.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.901+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T14:59:40.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.925+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T14:59:40.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.929+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T14:59:40.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.929+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T14:59:40.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.969+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T14:59:40.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.973+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:59:40.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.981+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:59:40.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.989+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T14:59:41.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:40.989+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.001+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.017+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.033+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.033+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.049+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.057+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.069+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.097+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.109+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T14:59:41.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.141+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.141+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.141+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.169+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.181+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.189+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.205+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.209+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:59:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.225+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:59:41.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.249+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:59:41.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.261+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:59:41.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.265+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T14:59:41.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.265+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:59:41.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.305+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T14:59:41.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.305+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T14:59:41.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.313+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:59:41.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.333+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T14:59:41.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.349+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:59:41.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.357+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T14:59:41.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.361+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T14:59:41.369 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 163 16 1779698 1779682 682.334 685.625 0.00084546 0.00145572 2024-09-16T14:59:41.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.369+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T14:59:41.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.401+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T14:59:41.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.417+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:59:41.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.425+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T14:59:41.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.437+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T14:59:41.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.469+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T14:59:41.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.473+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T14:59:41.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.477+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T14:59:41.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.485+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:59:41.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.497+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T14:59:41.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.505+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:41.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.545+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T14:59:41.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.561+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:59:41.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.573+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T14:59:41.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.577+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:59:41.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.589+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:59:41.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.621+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T14:59:41.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.637+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:59:41.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.665+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T14:59:41.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.673+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T14:59:41.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.697+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:59:41.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.721+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:59:41.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:59:41.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.733+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:59:41.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.737+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T14:59:41.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.761+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T14:59:41.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.761+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T14:59:41.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.769+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:59:41.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.785+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:59:41.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.833+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T14:59:41.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.853+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:59:41.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.857+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:59:41.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.877+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T14:59:41.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.901+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T14:59:41.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.929+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T14:59:41.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.929+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T14:59:41.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.953+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T14:59:41.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.961+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:41.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.969+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T14:59:41.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.993+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:59:42.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.997+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:59:42.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:41.997+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T14:59:42.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.009+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:59:42.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.041+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:59:42.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.065+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T14:59:42.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.077+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T14:59:42.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.085+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:59:42.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.085+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:59:42.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.093+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:59:42.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.093+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:59:42.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.145+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:59:42.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.161+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T14:59:42.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.165+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:59:42.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.169+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:59:42.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.193+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:59:42.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.217+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T14:59:42.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.225+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T14:59:42.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.225+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T14:59:42.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:42.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.265+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:59:42.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.269+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T14:59:42.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.285+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T14:59:42.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.313+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T14:59:42.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.325+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:42.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.349+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:59:42.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.349+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:59:42.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:59:42.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 164 16 1790824 1790808 682.413 695.375 0.00120401 0.00145554 2024-09-16T14:59:42.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.377+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:42.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.377+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:59:42.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.385+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:42.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.393+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:59:42.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.409+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T14:59:42.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.413+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:59:42.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.433+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T14:59:42.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.457+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T14:59:42.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.473+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:59:42.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.477+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:59:42.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.485+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:59:42.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.513+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T14:59:42.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.525+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T14:59:42.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T14:59:42.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.573+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T14:59:42.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.573+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T14:59:42.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.581+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T14:59:42.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.609+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:42.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.609+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:59:42.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.629+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:59:42.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.629+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T14:59:42.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.649+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:59:42.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.653+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:59:42.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.657+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:59:42.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.665+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T14:59:42.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.681+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T14:59:42.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.729+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:59:42.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.749+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:59:42.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.765+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:59:42.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.773+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T14:59:42.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.781+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:59:42.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.785+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T14:59:42.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.793+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:59:42.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.817+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T14:59:42.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.821+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:59:42.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.829+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T14:59:42.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.837+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:42.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.861+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T14:59:42.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.873+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T14:59:42.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.885+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:59:42.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.913+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:59:42.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.929+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:59:42.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.949+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T14:59:42.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.957+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:59:42.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.961+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T14:59:42.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.977+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:59:42.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.981+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T14:59:43.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:42.997+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:59:43.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.021+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:59:43.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.041+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:59:43.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.045+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:59:43.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.057+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:59:43.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.061+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T14:59:43.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.081+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T14:59:43.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.081+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:59:43.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.085+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T14:59:43.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.133+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T14:59:43.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.177+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T14:59:43.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.177+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T14:59:43.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.177+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T14:59:43.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.209+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T14:59:43.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.229+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:59:43.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.233+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:59:43.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.249+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:59:43.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.257+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T14:59:43.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.285+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:59:43.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.313+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:43.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.329+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:59:43.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.333+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:59:43.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.337+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:59:43.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 165 16 1801843 1801827 682.451 688.688 0.000876933 0.00145546 2024-09-16T14:59:43.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.381+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:59:43.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.385+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:59:43.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.385+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:59:43.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.393+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:59:43.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.413+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:59:43.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.421+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:59:43.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.437+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T14:59:43.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.453+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:59:43.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.469+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:59:43.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.513+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:43.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.525+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T14:59:43.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.533+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T14:59:43.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.573+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:59:43.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.597+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T14:59:43.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.613+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:59:43.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.621+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:59:43.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:59:43.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.649+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:59:43.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.653+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T14:59:43.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.657+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T14:59:43.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.681+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:59:43.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.685+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T14:59:43.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.725+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:59:43.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.749+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T14:59:43.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.761+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T14:59:43.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.765+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:59:43.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.797+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:59:43.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:59:43.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.801+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T14:59:43.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.813+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:43.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.817+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:59:43.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.841+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T14:59:43.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.861+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:59:43.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.889+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:59:43.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.905+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:59:43.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.925+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T14:59:43.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.929+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T14:59:43.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.945+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T14:59:43.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.977+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:59:43.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:43.981+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T14:59:44.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.005+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T14:59:44.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.013+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:59:44.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.013+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T14:59:44.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.017+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T14:59:44.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.037+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:59:44.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.069+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:59:44.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.077+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T14:59:44.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.089+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T14:59:44.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.097+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:59:44.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.101+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:59:44.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.117+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T14:59:44.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.125+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T14:59:44.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.149+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T14:59:44.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.161+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:59:44.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.189+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:59:44.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.217+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T14:59:44.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.233+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:59:44.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.233+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:59:44.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.237+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:59:44.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.245+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:59:44.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.281+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T14:59:44.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.301+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T14:59:44.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.317+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:59:44.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.333+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:59:44.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.337+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:59:44.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.349+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:59:44.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.357+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:59:44.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 166 16 1813024 1813008 682.549 698.812 0.000768343 0.00145525 2024-09-16T14:59:44.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.389+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T14:59:44.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.389+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T14:59:44.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.389+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T14:59:44.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.405+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T14:59:44.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.433+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T14:59:44.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.437+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:59:44.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.453+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:59:44.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:59:44.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.485+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T14:59:44.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.509+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T14:59:44.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.569+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:59:44.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.577+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T14:59:44.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.577+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:44.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.601+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:59:44.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.605+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:59:44.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.625+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T14:59:44.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:59:44.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.637+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T14:59:44.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.677+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:59:44.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.681+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T14:59:44.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.689+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T14:59:44.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.709+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T14:59:44.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.737+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T14:59:44.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.745+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:59:44.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.745+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T14:59:44.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.753+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T14:59:44.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.757+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T14:59:44.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.781+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T14:59:44.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.829+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T14:59:44.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.841+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T14:59:44.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.865+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:44.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.869+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:59:44.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.885+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:59:44.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.909+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T14:59:44.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.917+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:59:44.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.917+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T14:59:44.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.949+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:59:44.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.973+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:59:44.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.977+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T14:59:44.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.981+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T14:59:44.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.989+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T14:59:44.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:44.997+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T14:59:45.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.001+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T14:59:45.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.033+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:59:45.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.049+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T14:59:45.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.057+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T14:59:45.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.065+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T14:59:45.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.089+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:59:45.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.109+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:45.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T14:59:45.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.113+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:59:45.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T14:59:45.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.145+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T14:59:45.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.157+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:59:45.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.185+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T14:59:45.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.185+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:59:45.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.201+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T14:59:45.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.225+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T14:59:45.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.241+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:59:45.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.253+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:59:45.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.265+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T14:59:45.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.285+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:59:45.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.289+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:59:45.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.301+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:45.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.337+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:59:45.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.337+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:45.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.345+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:59:45.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.361+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T14:59:45.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 167 16 1823754 1823738 682.477 670.625 0.00357927 0.0014554 2024-09-16T14:59:45.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.381+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:59:45.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.381+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:59:45.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.401+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T14:59:45.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.401+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T14:59:45.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.421+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:59:45.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.437+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:59:45.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.445+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T14:59:45.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.461+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:59:45.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.493+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:59:45.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.505+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:59:45.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.513+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T14:59:45.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.525+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:59:45.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.541+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T14:59:45.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.541+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T14:59:45.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.545+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T14:59:45.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.585+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:59:45.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.605+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T14:59:45.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.621+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:59:45.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T14:59:45.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.637+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T14:59:45.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.677+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:59:45.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.697+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T14:59:45.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.741+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T14:59:45.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.745+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:59:45.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.757+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:59:45.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.769+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:59:45.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.773+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T14:59:45.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.797+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T14:59:45.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.805+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T14:59:45.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.837+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:59:45.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.837+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:45.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.849+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:45.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.853+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T14:59:45.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.857+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T14:59:45.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.885+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:45.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.897+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:59:45.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.913+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T14:59:45.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.925+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:59:45.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.953+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T14:59:45.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:45.969+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:59:46.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.001+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:59:46.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.001+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T14:59:46.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.025+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T14:59:46.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.029+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:59:46.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.029+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T14:59:46.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.049+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T14:59:46.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.061+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T14:59:46.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.073+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T14:59:46.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.085+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:46.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.105+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:59:46.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.157+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:59:46.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.157+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T14:59:46.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.165+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:59:46.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.169+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T14:59:46.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.173+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:59:46.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.181+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:59:46.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.241+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:59:46.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.245+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:46.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.257+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T14:59:46.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.265+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:59:46.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.281+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T14:59:46.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.297+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:46.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.301+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:59:46.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.309+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T14:59:46.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.321+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T14:59:46.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.349+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:59:46.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.361+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T14:59:46.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 168 16 1834453 1834437 682.395 668.688 0.00116721 0.00145557 2024-09-16T14:59:46.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.373+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T14:59:46.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.373+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T14:59:46.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.381+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:46.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.401+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:59:46.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.433+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:59:46.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.445+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:59:46.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.461+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T14:59:46.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.465+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:59:46.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.465+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T14:59:46.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.489+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:46.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.493+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T14:59:46.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.513+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T14:59:46.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.521+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T14:59:46.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.533+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T14:59:46.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.557+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T14:59:46.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.561+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T14:59:46.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.577+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T14:59:46.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.581+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:46.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.613+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T14:59:46.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.621+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:59:46.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.629+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T14:59:46.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.649+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:59:46.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.657+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T14:59:46.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.665+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:59:46.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.669+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:59:46.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.677+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T14:59:46.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:59:46.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.705+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T14:59:46.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.709+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:46.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.721+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T14:59:46.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.753+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T14:59:46.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.753+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T14:59:46.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.761+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T14:59:46.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.777+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:59:46.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.813+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:59:46.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.817+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:59:46.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.821+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T14:59:46.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.869+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T14:59:46.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.877+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:59:46.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.893+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T14:59:46.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.893+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:59:46.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.921+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T14:59:46.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.937+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:46.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.941+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:59:46.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.941+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T14:59:46.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.941+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:59:46.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.977+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:59:46.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:46.993+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T14:59:47.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.009+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T14:59:47.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.009+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:47.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.021+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:59:47.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.065+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T14:59:47.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.085+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:59:47.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.101+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T14:59:47.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.113+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:59:47.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.117+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:59:47.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.137+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T14:59:47.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.145+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T14:59:47.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.161+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:59:47.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.177+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T14:59:47.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.181+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T14:59:47.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.209+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:59:47.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.213+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T14:59:47.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.245+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:59:47.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.249+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T14:59:47.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.289+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T14:59:47.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.305+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T14:59:47.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.309+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T14:59:47.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.309+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:47.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.349+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:59:47.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.361+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T14:59:47.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.361+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T14:59:47.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 169 16 1845421 1845405 682.413 685.5 0.000811171 0.00145555 2024-09-16T14:59:47.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.373+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:59:47.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.393+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T14:59:47.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.401+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T14:59:47.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.445+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T14:59:47.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.445+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:59:47.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.457+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:59:47.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.473+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T14:59:47.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.481+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T14:59:47.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.489+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T14:59:47.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.501+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T14:59:47.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.513+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T14:59:47.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.525+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:47.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.545+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T14:59:47.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.549+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:59:47.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.549+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:59:47.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.561+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:59:47.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.589+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:59:47.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.593+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:59:47.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.601+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T14:59:47.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.617+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T14:59:47.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.629+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T14:59:47.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.645+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T14:59:47.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.649+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:59:47.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.657+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T14:59:47.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.673+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:59:47.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.685+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T14:59:47.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.725+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:59:47.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.725+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:59:47.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.769+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:59:47.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.769+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:59:47.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.781+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:59:47.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.801+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T14:59:47.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.817+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:59:47.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.821+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T14:59:47.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.825+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:47.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.849+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T14:59:47.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.857+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:59:47.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.881+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:59:47.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.881+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:47.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.905+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T14:59:47.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.905+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:47.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.909+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:59:47.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.925+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T14:59:47.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.933+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:59:47.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.937+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T14:59:47.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.961+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:59:47.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.973+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:59:47.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:47.977+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:59:48.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.013+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T14:59:48.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.017+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:59:48.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.021+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T14:59:48.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.029+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:59:48.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.057+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T14:59:48.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.085+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:59:48.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.089+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T14:59:48.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.101+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T14:59:48.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.149+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:59:48.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.173+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T14:59:48.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.173+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:59:48.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.181+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:48.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.181+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T14:59:48.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.249+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:59:48.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.285+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:59:48.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.305+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:59:48.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.321+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T14:59:48.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.337+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:59:48.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.353+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T14:59:48.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.361+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:59:48.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 170 15 1856438 1856423 682.449 688.625 0.000985779 0.00145548 2024-09-16T14:59:48.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.385+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:59:48.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.401+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T14:59:48.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.429+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T14:59:48.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.437+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:59:48.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.453+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T14:59:48.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.477+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T14:59:48.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.513+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T14:59:48.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.541+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T14:59:48.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.557+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T14:59:48.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.565+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T14:59:48.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.569+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T14:59:48.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.581+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T14:59:48.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.593+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T14:59:48.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.609+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T14:59:48.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.633+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:59:48.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T14:59:48.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.637+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T14:59:48.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.645+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T14:59:48.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.661+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T14:59:48.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.673+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T14:59:48.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.697+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:59:48.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.709+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:48.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.709+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:59:48.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.733+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T14:59:48.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.749+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:59:48.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.765+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T14:59:48.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.769+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T14:59:48.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.793+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:59:48.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.805+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:59:48.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.809+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:59:48.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.809+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T14:59:48.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.821+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T14:59:48.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.833+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T14:59:48.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.877+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:59:48.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.877+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T14:59:48.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.885+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T14:59:48.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.905+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T14:59:48.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.909+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:59:48.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.929+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:48.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.953+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T14:59:48.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.977+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T14:59:48.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:48.977+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T14:59:49.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.009+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T14:59:49.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.017+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T14:59:49.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.025+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:49.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.057+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:59:49.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.061+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:49.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.073+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:59:49.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.093+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:59:49.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.113+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T14:59:49.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.121+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T14:59:49.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.133+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T14:59:49.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.137+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T14:59:49.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.149+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T14:59:49.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.165+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:59:49.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.165+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T14:59:49.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.201+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T14:59:49.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.213+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T14:59:49.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.217+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T14:59:49.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.297+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T14:59:49.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.297+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T14:59:49.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.301+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:59:49.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.301+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T14:59:49.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.341+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T14:59:49.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 171 16 1867827 1867811 682.62 711.75 0.000830963 0.00145511 2024-09-16T14:59:49.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.381+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T14:59:49.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.389+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:59:49.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.397+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:59:49.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.421+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T14:59:49.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.433+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:59:49.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.449+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T14:59:49.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.453+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T14:59:49.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.461+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:59:49.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.493+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T14:59:49.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.493+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T14:59:49.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.497+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T14:59:49.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.529+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T14:59:49.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.541+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T14:59:49.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.549+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:59:49.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.557+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:59:49.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.581+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:49.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.585+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:59:49.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.609+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:59:49.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.617+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:49.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:59:49.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.633+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:59:49.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.661+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:59:49.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.673+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:49.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.693+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:49.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.693+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T14:59:49.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.705+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T14:59:49.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.709+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:59:49.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.733+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:59:49.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.761+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:59:49.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.769+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T14:59:49.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.777+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:59:49.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.777+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T14:59:49.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.785+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T14:59:49.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.801+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:59:49.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.817+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T14:59:49.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.829+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T14:59:49.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.849+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:59:49.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.865+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:49.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.881+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T14:59:49.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.901+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:59:49.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.905+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T14:59:49.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.925+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:49.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.957+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T14:59:49.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.957+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T14:59:49.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:49.973+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:59:50.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.001+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T14:59:50.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.005+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T14:59:50.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.029+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:59:50.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.037+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:59:50.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.053+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T14:59:50.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.061+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T14:59:50.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.077+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:59:50.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.105+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:59:50.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.109+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:59:50.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.137+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:59:50.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.145+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T14:59:50.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.153+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T14:59:50.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.161+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T14:59:50.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.185+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T14:59:50.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.185+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T14:59:50.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.185+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T14:59:50.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.217+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:50.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.233+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T14:59:50.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.253+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T14:59:50.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:59:50.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.273+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:59:50.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.277+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T14:59:50.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.277+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:50.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.301+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:59:50.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.305+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:59:50.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.309+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:59:50.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.329+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:59:50.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.333+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T14:59:50.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 172 16 1878591 1878575 682.563 672.75 0.000576439 0.00145519 2024-09-16T14:59:50.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.389+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T14:59:50.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.401+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:59:50.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.417+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:59:50.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.445+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T14:59:50.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.453+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:59:50.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.457+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:59:50.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.461+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T14:59:50.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.481+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T14:59:50.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.517+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T14:59:50.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.549+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:59:50.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.549+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:59:50.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.553+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T14:59:50.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.569+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:50.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.577+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T14:59:50.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.581+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:59:50.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.617+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:59:50.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.629+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:59:50.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.633+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:59:50.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.637+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:59:50.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.645+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T14:59:50.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.661+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:59:50.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.705+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:59:50.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.729+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:59:50.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.733+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:59:50.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.737+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T14:59:50.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.833+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:59:50.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.837+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T14:59:50.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.877+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:59:50.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.885+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T14:59:50.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.905+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T14:59:50.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.921+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:59:50.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.933+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T14:59:50.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.945+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:59:50.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.957+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T14:59:50.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.965+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T14:59:50.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.981+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T14:59:50.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.993+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T14:59:50.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:50.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T14:59:51.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.013+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T14:59:51.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.041+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T14:59:51.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.045+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T14:59:51.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.065+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:59:51.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.089+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:59:51.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.097+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T14:59:51.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.101+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:59:51.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.105+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T14:59:51.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.113+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T14:59:51.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T14:59:51.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.129+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T14:59:51.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.153+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T14:59:51.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.197+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:59:51.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.205+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T14:59:51.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.213+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T14:59:51.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.233+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T14:59:51.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.245+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:59:51.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.257+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:51.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.273+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T14:59:51.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.277+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:59:51.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.309+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:59:51.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.313+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:59:51.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.329+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T14:59:51.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T14:59:51.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.357+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T14:59:51.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 173 16 1888673 1888657 682.259 630.125 0.000830324 0.00145588 2024-09-16T14:59:51.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.373+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T14:59:51.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.401+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T14:59:51.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.401+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:59:51.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.405+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T14:59:51.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.425+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T14:59:51.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.429+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T14:59:51.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.465+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T14:59:51.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.473+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:59:51.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.481+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T14:59:51.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.489+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T14:59:51.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.493+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:59:51.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.501+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T14:59:51.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.509+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T14:59:51.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.573+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T14:59:51.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.581+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T14:59:51.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.581+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T14:59:51.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.593+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T14:59:51.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.593+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T14:59:51.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.609+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:59:51.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.649+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T14:59:51.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.657+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T14:59:51.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.677+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T14:59:51.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.701+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T14:59:51.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.705+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T14:59:51.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.741+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T14:59:51.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.749+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T14:59:51.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.761+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:59:51.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.793+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T14:59:51.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.809+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T14:59:51.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.817+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T14:59:51.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.841+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T14:59:51.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.845+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:51.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.861+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:59:51.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.865+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:59:51.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.889+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T14:59:51.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.897+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T14:59:51.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.905+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T14:59:51.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.905+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:59:51.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.925+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:51.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.941+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T14:59:51.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.961+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T14:59:51.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.985+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T14:59:51.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.989+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T14:59:51.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.993+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T14:59:52.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:51.997+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T14:59:52.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.029+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T14:59:52.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.049+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T14:59:52.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.065+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:59:52.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.065+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T14:59:52.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.089+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T14:59:52.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.093+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T14:59:52.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.097+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:59:52.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.101+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T14:59:52.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.117+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T14:59:52.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T14:59:52.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.137+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T14:59:52.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.153+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T14:59:52.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.169+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:59:52.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.169+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T14:59:52.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.205+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T14:59:52.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.217+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T14:59:52.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.233+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T14:59:52.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.257+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:59:52.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.273+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T14:59:52.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.277+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T14:59:52.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.277+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:59:52.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.289+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T14:59:52.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.317+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T14:59:52.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.345+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T14:59:52.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.369+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:59:52.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 174 15 1899529 1899514 682.238 678.562 0.000906607 0.00145593 2024-09-16T14:59:52.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.385+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T14:59:52.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.393+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T14:59:52.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.433+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T14:59:52.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.437+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T14:59:52.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.461+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T14:59:52.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.469+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T14:59:52.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.481+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T14:59:52.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.501+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:59:52.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.529+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:59:52.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.529+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:59:52.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T14:59:52.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.577+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T14:59:52.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.593+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T14:59:52.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.593+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:59:52.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.601+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:59:52.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.617+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T14:59:52.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T14:59:52.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.661+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T14:59:52.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.677+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:52.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.697+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T14:59:52.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.701+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T14:59:52.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.705+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T14:59:52.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.713+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T14:59:52.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.749+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T14:59:52.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.757+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:59:52.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.769+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T14:59:52.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.781+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T14:59:52.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.789+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:59:52.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.801+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T14:59:52.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.821+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:59:52.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.833+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:59:52.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.841+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T14:59:52.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.853+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T14:59:52.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.861+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T14:59:52.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.877+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T14:59:52.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.885+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:59:52.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.889+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:59:52.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.905+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T14:59:52.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.937+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T14:59:52.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.949+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:59:52.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.981+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:59:52.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.989+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:59:52.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.989+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T14:59:53.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:52.997+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T14:59:53.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.025+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T14:59:53.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.065+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T14:59:53.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.081+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:59:53.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.105+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T14:59:53.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.125+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T14:59:53.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.129+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:53.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.137+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:59:53.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.141+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:59:53.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.157+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T14:59:53.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.185+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T14:59:53.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.193+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T14:59:53.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.201+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T14:59:53.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.233+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T14:59:53.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.233+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T14:59:53.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.261+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T14:59:53.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T14:59:53.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.289+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:59:53.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.293+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:59:53.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.329+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T14:59:53.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.337+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T14:59:53.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:59:53.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 175 16 1911013 1910997 682.44 717.688 0.000855574 0.00145548 2024-09-16T14:59:53.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.377+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T14:59:53.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.381+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T14:59:53.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.393+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T14:59:53.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.401+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T14:59:53.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.409+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T14:59:53.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.421+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T14:59:53.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.437+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T14:59:53.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.441+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T14:59:53.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.453+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T14:59:53.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.461+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T14:59:53.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.497+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T14:59:53.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.525+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T14:59:53.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.533+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T14:59:53.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.557+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T14:59:53.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.585+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T14:59:53.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.605+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T14:59:53.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.605+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T14:59:53.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.641+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T14:59:53.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.641+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T14:59:53.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.649+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T14:59:53.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.673+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T14:59:53.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.693+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T14:59:53.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.693+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:59:53.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.697+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T14:59:53.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.721+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T14:59:53.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.769+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:59:53.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.773+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T14:59:53.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.781+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:59:53.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.785+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:59:53.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.785+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T14:59:53.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.825+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T14:59:53.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.857+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:59:53.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.865+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:59:53.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.869+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T14:59:53.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.889+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T14:59:53.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.901+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T14:59:53.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.901+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T14:59:53.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.913+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T14:59:53.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.917+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T14:59:53.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.945+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T14:59:53.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:53.953+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T14:59:54.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.021+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:59:54.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.021+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T14:59:54.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.033+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T14:59:54.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.061+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T14:59:54.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.061+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T14:59:54.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.097+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T14:59:54.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.113+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:59:54.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.129+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:59:54.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.133+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T14:59:54.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.153+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T14:59:54.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.165+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T14:59:54.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.173+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:59:54.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.185+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T14:59:54.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.185+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T14:59:54.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.189+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T14:59:54.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.249+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T14:59:54.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.249+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T14:59:54.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.261+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T14:59:54.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.289+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:59:54.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.293+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T14:59:54.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.321+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T14:59:54.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.325+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T14:59:54.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.345+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T14:59:54.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.357+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T14:59:54.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.365+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T14:59:54.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 176 16 1922340 1922324 682.584 707.938 0.00123561 0.00145518 2024-09-16T14:59:54.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.377+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T14:59:54.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.401+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:59:54.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.401+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T14:59:54.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.409+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T14:59:54.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.417+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T14:59:54.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.453+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T14:59:54.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.457+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T14:59:54.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.473+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T14:59:54.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.489+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T14:59:54.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.497+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T14:59:54.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.505+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T14:59:54.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.521+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T14:59:54.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.545+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T14:59:54.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.549+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T14:59:54.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.553+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:59:54.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.557+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:59:54.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.569+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T14:59:54.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.581+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:59:54.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.585+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T14:59:54.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.609+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T14:59:54.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.613+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T14:59:54.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.629+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T14:59:54.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.629+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:54.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.665+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T14:59:54.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.677+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:59:54.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.685+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:59:54.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.689+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T14:59:54.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.709+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T14:59:54.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.713+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:59:54.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.713+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T14:59:54.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.737+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T14:59:54.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.765+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T14:59:54.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.785+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:59:54.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.801+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:59:54.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.801+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:59:54.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.801+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T14:59:54.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.809+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:54.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.817+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:59:54.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.853+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T14:59:54.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.853+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:59:54.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.897+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T14:59:54.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.897+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T14:59:54.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.913+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T14:59:54.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.917+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T14:59:54.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.929+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T14:59:54.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.949+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:59:54.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.953+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:54.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.973+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T14:59:54.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.977+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T14:59:54.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.977+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T14:59:54.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:54.997+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:59:55.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.005+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T14:59:55.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.013+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T14:59:55.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.061+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:59:55.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.089+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:59:55.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.089+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T14:59:55.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.129+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T14:59:55.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.145+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T14:59:55.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.161+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T14:59:55.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.169+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T14:59:55.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.185+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:59:55.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.189+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:59:55.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.193+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:59:55.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.205+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:59:55.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.241+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T14:59:55.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.269+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:59:55.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.277+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:55.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.285+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T14:59:55.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.285+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T14:59:55.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.293+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T14:59:55.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.341+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T14:59:55.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.345+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T14:59:55.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T14:59:55.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.361+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T14:59:55.370 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 177 16 1933233 1933217 682.574 680.812 0.0252166 0.00145519 2024-09-16T14:59:55.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.373+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T14:59:55.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.409+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T14:59:55.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.417+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T14:59:55.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.425+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T14:59:55.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.437+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:59:55.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.449+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T14:59:55.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.469+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T14:59:55.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.469+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:59:55.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.501+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T14:59:55.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.513+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T14:59:55.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.541+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T14:59:55.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.565+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T14:59:55.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.581+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T14:59:55.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.589+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T14:59:55.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.601+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T14:59:55.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.641+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T14:59:55.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.641+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T14:59:55.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.641+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T14:59:55.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.641+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T14:59:55.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.697+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T14:59:55.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.713+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T14:59:55.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.717+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T14:59:55.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.729+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:59:55.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.733+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T14:59:55.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.749+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T14:59:55.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.769+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T14:59:55.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.781+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T14:59:55.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.781+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T14:59:55.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.801+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T14:59:55.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.801+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:59:55.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.801+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T14:59:55.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.869+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T14:59:55.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.877+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T14:59:55.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.889+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:55.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.893+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T14:59:55.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.933+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T14:59:55.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.937+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T14:59:55.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.941+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T14:59:55.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.953+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T14:59:55.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.973+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T14:59:55.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.989+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T14:59:55.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:55.993+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:59:56.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.017+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T14:59:56.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.061+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T14:59:56.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.061+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T14:59:56.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.061+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T14:59:56.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.093+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T14:59:56.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.105+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T14:59:56.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T14:59:56.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.125+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T14:59:56.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.133+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:59:56.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.141+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T14:59:56.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.241+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T14:59:56.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.261+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:56.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.293+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T14:59:56.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.305+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T14:59:56.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.325+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T14:59:56.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.353+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T14:59:56.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 178 16 1943058 1943042 682.189 614.062 0.0043298 0.00145603 2024-09-16T14:59:56.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.373+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T14:59:56.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.405+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T14:59:56.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.441+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T14:59:56.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.453+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T14:59:56.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.477+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T14:59:56.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.477+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T14:59:56.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.501+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T14:59:56.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.517+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T14:59:56.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.525+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T14:59:56.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.529+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T14:59:56.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.537+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T14:59:56.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.549+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T14:59:56.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.565+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T14:59:56.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.577+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:59:56.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.585+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T14:59:56.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.597+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T14:59:56.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.625+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T14:59:56.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.633+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T14:59:56.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.673+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T14:59:56.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.673+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T14:59:56.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.693+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T14:59:56.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.713+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T14:59:56.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.729+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T14:59:56.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.745+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T14:59:56.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.757+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:59:56.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.761+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T14:59:56.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.797+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T14:59:56.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.809+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T14:59:56.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:56.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.821+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T14:59:56.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.841+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T14:59:56.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.853+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T14:59:56.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.861+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T14:59:56.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.869+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T14:59:56.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.881+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T14:59:56.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.897+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T14:59:56.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.905+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T14:59:56.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.933+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:59:56.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.937+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T14:59:56.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.949+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:59:56.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.961+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T14:59:56.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.993+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:59:57.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:56.997+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:57.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.021+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T14:59:57.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.025+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T14:59:57.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.037+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T14:59:57.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.041+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:57.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.049+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T14:59:57.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.061+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T14:59:57.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.061+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T14:59:57.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.085+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T14:59:57.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.089+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T14:59:57.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.101+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T14:59:57.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.165+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T14:59:57.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.165+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T14:59:57.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.173+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:59:57.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.181+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T14:59:57.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.229+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T14:59:57.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.237+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T14:59:57.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.249+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T14:59:57.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.253+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T14:59:57.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.293+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T14:59:57.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.297+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T14:59:57.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.313+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T14:59:57.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.325+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T14:59:57.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.333+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T14:59:57.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.337+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T14:59:57.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 179 15 1954023 1954008 682.206 685.375 0.002318 0.00145598 2024-09-16T14:59:57.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.397+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T14:59:57.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.405+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:59:57.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.421+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T14:59:57.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.449+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T14:59:57.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.449+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T14:59:57.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.477+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T14:59:57.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.477+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T14:59:57.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.481+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T14:59:57.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.489+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T14:59:57.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.517+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T14:59:57.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.537+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T14:59:57.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.585+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T14:59:57.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.593+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T14:59:57.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.593+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T14:59:57.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.629+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:59:57.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.629+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T14:59:57.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.633+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T14:59:57.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.657+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T14:59:57.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.673+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T14:59:57.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.677+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T14:59:57.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T14:59:57.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.705+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T14:59:57.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.729+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T14:59:57.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.737+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:57.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.757+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T14:59:57.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.761+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T14:59:57.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.777+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T14:59:57.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.785+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T14:59:57.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.785+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T14:59:57.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.817+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T14:59:57.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.825+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T14:59:57.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.837+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T14:59:57.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.837+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T14:59:57.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.845+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T14:59:57.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.869+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T14:59:57.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.885+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T14:59:57.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.901+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T14:59:57.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.909+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T14:59:57.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.917+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:57.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.921+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T14:59:57.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.945+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T14:59:57.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T14:59:57.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.989+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T14:59:57.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:57.997+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T14:59:58.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.013+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T14:59:58.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.013+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T14:59:58.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.025+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T14:59:58.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.033+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T14:59:58.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.077+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T14:59:58.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.081+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T14:59:58.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.093+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T14:59:58.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:59:58.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.117+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T14:59:58.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.125+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T14:59:58.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.133+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T14:59:58.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.165+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T14:59:58.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.169+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T14:59:58.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.181+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T14:59:58.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.213+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T14:59:58.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.217+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T14:59:58.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.221+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T14:59:58.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.229+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T14:59:58.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.253+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T14:59:58.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.269+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T14:59:58.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.273+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T14:59:58.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.289+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T14:59:58.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.305+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T14:59:58.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.325+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T14:59:58.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.329+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:59:58.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.329+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T14:59:58.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T14:59:58.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T14:59:58.371122+0000 min lat: 0.000220975 max lat: 0.16813 avg lat: 0.00145583 2024-09-16T14:59:58.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T14:59:58.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 180 15 1965132 1965117 682.273 694.312 0.000660953 0.00145583 2024-09-16T14:59:58.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.373+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T14:59:58.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.381+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T14:59:58.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.401+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T14:59:58.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.409+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T14:59:58.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.417+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T14:59:58.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.421+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T14:59:58.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.433+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T14:59:58.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.469+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T14:59:58.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.501+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T14:59:58.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.509+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T14:59:58.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.509+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T14:59:58.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.513+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T14:59:58.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.513+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T14:59:58.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.533+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T14:59:58.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T14:59:58.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.561+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T14:59:58.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.581+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T14:59:58.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.585+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T14:59:58.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.589+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T14:59:58.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.633+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T14:59:58.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.641+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:59:58.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.645+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T14:59:58.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.649+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:59:58.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.661+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:59:58.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.677+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:58.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.689+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T14:59:58.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.701+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T14:59:58.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.725+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T14:59:58.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.725+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T14:59:58.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.733+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T14:59:58.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.781+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T14:59:58.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.781+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T14:59:58.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.781+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T14:59:58.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.789+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T14:59:58.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T14:59:58.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.801+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T14:59:58.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.821+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T14:59:58.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.861+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T14:59:58.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.885+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T14:59:58.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.901+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T14:59:58.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.905+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T14:59:58.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.925+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T14:59:58.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.929+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T14:59:58.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.965+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T14:59:58.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T14:59:58.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:58.997+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T14:59:59.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.021+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T14:59:59.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.049+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T14:59:59.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.049+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T14:59:59.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.053+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T14:59:59.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.073+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T14:59:59.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.105+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T14:59:59.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.105+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T14:59:59.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.125+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T14:59:59.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.157+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T14:59:59.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.181+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T14:59:59.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.193+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T14:59:59.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.201+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T14:59:59.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.213+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T14:59:59.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.217+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T14:59:59.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.229+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T14:59:59.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.237+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T14:59:59.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.253+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T14:59:59.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.285+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T14:59:59.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.309+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T14:59:59.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.325+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T14:59:59.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.341+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T14:59:59.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 181 16 1976090 1976074 682.287 684.812 0.00114175 0.00145582 2024-09-16T14:59:59.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.369+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T14:59:59.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.385+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T14:59:59.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.389+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T14:59:59.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.389+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T14:59:59.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.397+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T14:59:59.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.409+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T14:59:59.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.433+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T14:59:59.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.445+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T14:59:59.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T14:59:59.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.485+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T14:59:59.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.489+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T14:59:59.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.493+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T14:59:59.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.493+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T14:59:59.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.545+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T14:59:59.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.549+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T14:59:59.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.549+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T14:59:59.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.557+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T14:59:59.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.581+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T14:59:59.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.613+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T14:59:59.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.633+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T14:59:59.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.637+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T14:59:59.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.669+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T14:59:59.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.689+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T14:59:59.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.713+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T14:59:59.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.713+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T14:59:59.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.721+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T14:59:59.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.729+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T14:59:59.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.733+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T14:59:59.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.757+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T14:59:59.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.809+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T14:59:59.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.813+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T14:59:59.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.813+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T14:59:59.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.845+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T14:59:59.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.873+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T14:59:59.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.881+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T14:59:59.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.897+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T14:59:59.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.897+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T14:59:59.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.917+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T14:59:59.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.925+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T14:59:59.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.929+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T14:59:59.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.937+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T14:59:59.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.949+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T14:59:59.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.957+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T14:59:59.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.969+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T14:59:59.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T14:59:59.989+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:00:00.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.001+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T15:00:00.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.017+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:00:00.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.017+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:00:00.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.033+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:00:00.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.069+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:00:00.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.073+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:00:00.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.077+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:00.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.093+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:00:00.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.113+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:00:00.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:00:00.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.117+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:00:00.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.141+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:00:00.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.153+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:00:00.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.169+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:00:00.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.181+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:00:00.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.181+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:00:00.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.193+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:00:00.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.193+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:00:00.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.217+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:00:00.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.217+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:00.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.269+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:00.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.281+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:00:00.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.289+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T15:00:00.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.297+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:00:00.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.309+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:00:00.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.321+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:00:00.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.321+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:00:00.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:00.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.361+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:00:00.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 182 16 1986813 1986797 682.22 670.188 0.0011218 0.00145594 2024-09-16T15:00:00.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.377+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:00.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.405+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:00:00.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.421+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:00:00.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.441+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:00:00.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.449+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:00:00.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.485+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:00:00.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.489+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:00.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.517+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:00:00.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.525+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:00:00.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.541+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:00:00.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.545+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:00:00.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.581+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:00:00.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.585+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:00:00.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.613+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:00:00.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.617+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:00:00.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.645+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T15:00:00.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.661+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:00:00.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.705+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:00:00.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.713+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:00:00.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.721+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:00:00.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.725+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:00:00.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.733+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:00:00.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.757+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:00:00.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.765+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:00:00.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.781+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:00:00.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.805+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:00:00.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.817+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:00:00.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:00:00.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.833+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:00:00.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.853+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:00:00.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.869+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:00.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.881+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:00:00.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.897+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:00:00.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.933+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:00:00.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.957+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:00:00.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:00:00.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:00.973+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:00:01.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.013+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:00:01.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.037+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:00:01.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.037+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:00:01.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.065+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:00:01.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.073+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:00:01.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.089+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:00:01.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.093+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:00:01.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.101+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:01.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.117+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:01.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.121+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:00:01.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.157+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:00:01.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.161+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:00:01.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.169+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:00:01.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.197+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:00:01.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.201+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:00:01.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.205+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:00:01.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.241+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:00:01.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.245+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:00:01.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.261+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:00:01.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.273+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:01.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:00:01.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.281+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:00:01.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.305+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T15:00:01.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.317+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:00:01.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.325+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:00:01.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.353+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:00:01.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.357+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:00:01.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.361+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:00:01.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.361+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T15:00:01.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 183 16 1998370 1998354 682.439 722.312 0.00084549 0.00145548 2024-09-16T15:00:01.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.373+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:00:01.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.401+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:01.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.413+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:00:01.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.425+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:00:01.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.433+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:00:01.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.437+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:00:01.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.461+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:00:01.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.477+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:00:01.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.477+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.485+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.489+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.505+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.529+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.549+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.565+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.569+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.569+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.613+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T15:00:01.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.617+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.625+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.649+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.665+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.669+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.685+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.701+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.717+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.717+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.729+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.733+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.753+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:00:01.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.777+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:00:01.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.793+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:00:01.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.805+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:00:01.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.829+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:00:01.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.849+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:00:01.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.857+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:00:01.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.861+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:00:01.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.861+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:00:01.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.861+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:00:01.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.897+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:01.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.913+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:01.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.925+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:00:01.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.929+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:00:01.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.933+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:00:01.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.945+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T15:00:01.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:01.953+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:00:02.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.001+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:00:02.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.029+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T15:00:02.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.029+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:02.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.037+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:00:02.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.057+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:00:02.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.057+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:00:02.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.065+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:00:02.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.073+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:02.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.081+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T15:00:02.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.121+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:00:02.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:00:02.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.129+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:00:02.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.137+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:00:02.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.165+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:02.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.181+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:00:02.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.185+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:00:02.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.197+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:00:02.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.213+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:00:02.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.225+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:00:02.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.241+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:00:02.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.277+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:00:02.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.281+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:00:02.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.309+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:00:02.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.313+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:00:02.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.345+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:02.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.349+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:00:02.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:00:02.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.369+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:00:02.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 184 16 2009377 2009361 682.468 687.938 0.000701093 0.00145542 2024-09-16T15:00:02.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.381+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:00:02.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.405+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:00:02.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.413+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:00:02.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.437+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:02.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.445+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:00:02.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.461+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:00:02.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.473+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:00:02.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.481+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:00:02.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.505+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:00:02.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.521+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:00:02.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.533+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:00:02.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.541+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:00:02.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.561+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T15:00:02.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.569+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:00:02.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.601+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:00:02.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.605+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:00:02.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.621+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:00:02.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.625+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:00:02.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.625+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:00:02.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.645+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:02.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.653+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:02.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.657+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T15:00:02.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.681+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:00:02.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.685+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:00:02.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.705+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:00:02.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.717+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:00:02.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.737+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:00:02.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.757+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:00:02.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.757+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:02.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.765+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:00:02.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.773+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:00:02.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.793+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:00:02.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.801+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:00:02.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.805+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:00:02.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.821+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:00:02.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.829+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:02.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.833+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:02.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.857+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:00:02.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.873+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:00:02.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.881+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:00:02.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.909+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:00:02.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.917+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:00:02.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.917+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T15:00:02.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.945+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:02.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.949+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:00:02.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.953+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:00:02.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.953+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:00:02.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.981+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:00:02.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.981+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:00:02.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:02.985+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:00:03.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.009+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:00:03.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.013+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T15:00:03.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.053+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:00:03.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.057+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T15:00:03.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.073+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:00:03.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.081+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:00:03.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.097+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:00:03.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.109+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:00:03.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.117+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:00:03.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.145+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:00:03.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.145+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:00:03.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.161+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:00:03.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.161+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:00:03.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.173+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:00:03.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.193+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:00:03.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.217+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:00:03.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.229+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:03.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.253+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:00:03.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.257+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:00:03.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.273+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:03.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.285+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:03.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.305+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:00:03.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.309+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:03.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.353+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:00:03.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:00:03.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 185 16 2020326 2020310 682.478 684.312 0.00349134 0.00145539 2024-09-16T15:00:03.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.433+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:03.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.441+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:00:03.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.445+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:00:03.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.465+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T15:00:03.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.473+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:00:03.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.489+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:00:03.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.509+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:00:03.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.513+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:00:03.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.533+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:00:03.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.537+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:03.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.549+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:00:03.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.573+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:00:03.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.589+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:00:03.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.601+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:00:03.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.605+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:00:03.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.613+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:00:03.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.625+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:00:03.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.653+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T15:00:03.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.669+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:00:03.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.693+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T15:00:03.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.705+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:00:03.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.725+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:00:03.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.737+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:00:03.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.749+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T15:00:03.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.749+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:00:03.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.757+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:00:03.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.777+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T15:00:03.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.793+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:00:03.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:00:03.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.825+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:00:03.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.841+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:00:03.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.845+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:00:03.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.877+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:00:03.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.881+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:00:03.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.901+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T15:00:03.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.901+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:00:03.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.925+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:03.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.949+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:00:03.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.953+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:00:03.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T15:00:03.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:03.981+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:00:04.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.013+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:00:04.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.013+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:00:04.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.033+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:00:04.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.037+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:04.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.045+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:00:04.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.053+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:00:04.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.081+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:00:04.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.081+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:00:04.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.105+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:00:04.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.117+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:00:04.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.149+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:00:04.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.157+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:00:04.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.165+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:00:04.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.189+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:00:04.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.209+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:00:04.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.225+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:04.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.225+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:00:04.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.257+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:00:04.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.261+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:00:04.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.277+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:00:04.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.281+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:00:04.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.289+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:00:04.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.309+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:00:04.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.313+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:00:04.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.325+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:00:04.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.345+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:00:04.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:00:04.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.357+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:04.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 186 16 2031752 2031736 682.648 714.125 0.000674503 0.00145501 2024-09-16T15:00:04.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.401+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:00:04.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.425+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:00:04.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.441+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:00:04.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.445+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:00:04.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.449+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:00:04.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.449+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:04.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.481+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:00:04.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.489+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:00:04.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.505+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:00:04.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.529+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:00:04.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.545+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:00:04.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.573+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:00:04.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.573+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:00:04.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.577+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:00:04.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.581+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:04.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.589+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:00:04.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.637+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:00:04.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.653+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:04.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.661+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:00:04.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.677+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:00:04.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:00:04.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.709+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:00:04.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.713+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:00:04.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.733+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:00:04.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.745+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:00:04.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.749+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:00:04.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.749+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:00:04.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.769+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:00:04.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.777+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:00:04.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.789+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:00:04.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.805+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:00:04.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.813+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:00:04.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.825+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:00:04.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.841+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:00:04.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.849+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T15:00:04.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.857+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:00:04.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.873+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:00:04.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.893+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:04.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.921+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:00:04.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.965+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:00:04.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.981+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:00:04.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:04.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:05.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.005+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:00:05.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.005+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:00:05.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.009+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:00:05.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.029+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:00:05.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.037+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:05.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.045+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:05.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.073+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:05.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.089+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:00:05.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.101+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:00:05.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.105+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:05.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.113+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:00:05.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.113+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:00:05.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.181+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:00:05.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.185+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:00:05.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.185+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:00:05.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.201+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:00:05.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.209+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:00:05.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.221+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:00:05.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.225+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:05.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.265+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:00:05.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.265+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:00:05.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.269+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:00:05.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.277+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:00:05.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.285+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:00:05.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.301+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T15:00:05.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.313+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:00:05.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.321+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:00:05.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.357+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:05.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.361+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:00:05.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.365+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:00:05.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 187 16 2042642 2042626 682.637 680.625 0.000860098 0.00145506 2024-09-16T15:00:05.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.369+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:05.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.373+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:00:05.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.465+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:00:05.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.469+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:00:05.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.489+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:00:05.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.489+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:05.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.505+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:00:05.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.513+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:00:05.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.521+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:00:05.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.529+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:05.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.545+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:05.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.549+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:00:05.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.557+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:00:05.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.605+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T15:00:05.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.629+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:00:05.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.645+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:00:05.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.665+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:00:05.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.665+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:00:05.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T15:00:05.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.681+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:05.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.697+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:00:05.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.701+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:00:05.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.705+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:00:05.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.717+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:00:05.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.729+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T15:00:05.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.745+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:00:05.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:00:05.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.797+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:05.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.837+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:00:05.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.841+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:05.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.845+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:00:05.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.909+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:00:05.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.949+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:00:05.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.949+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:00:05.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.961+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:00:05.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.965+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:00:05.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.973+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:05.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:05.993+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:00:06.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.009+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:00:06.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.049+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:00:06.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.065+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:00:06.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.101+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:00:06.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.117+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T15:00:06.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.125+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:00:06.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.145+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T15:00:06.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.153+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:00:06.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.157+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:00:06.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.181+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:00:06.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.205+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:00:06.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.205+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:06.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.217+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:00:06.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.221+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:00:06.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.233+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:00:06.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.253+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:00:06.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.269+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:00:06.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.273+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:00:06.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.341+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:00:06.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.345+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:06.371 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 188 16 2054071 2054055 682.805 714.312 0.00217232 0.00145471 2024-09-16T15:00:06.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.381+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:00:06.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.381+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T15:00:06.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.409+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:00:06.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.417+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:00:06.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.445+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:00:06.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.453+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:00:06.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.457+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:00:06.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.481+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:00:06.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.489+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:00:06.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.509+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:00:06.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.509+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:00:06.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.521+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:06.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.533+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T15:00:06.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.537+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:00:06.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.545+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:00:06.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.545+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:00:06.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.569+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:00:06.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.581+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T15:00:06.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.617+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:06.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.617+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:00:06.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.617+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:00:06.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.629+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:00:06.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.637+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:00:06.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.665+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:00:06.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.669+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:00:06.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.685+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:00:06.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:00:06.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.737+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T15:00:06.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.757+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:00:06.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.769+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:00:06.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.781+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:00:06.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.789+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:00:06.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.821+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:00:06.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.829+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:00:06.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.861+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:00:06.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.865+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:06.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.873+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T15:00:06.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.897+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T15:00:06.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.905+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:00:06.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.917+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T15:00:06.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.917+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:00:06.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.937+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:00:06.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.937+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:00:06.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.973+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:00:06.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.973+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:00:06.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.981+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:00:06.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:06.985+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:00:07.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.009+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:00:07.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.021+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:00:07.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.025+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:00:07.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.045+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T15:00:07.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.053+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:00:07.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.061+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:00:07.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.077+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:00:07.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.109+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T15:00:07.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.113+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:00:07.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.113+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T15:00:07.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.153+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:00:07.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.185+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:00:07.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.185+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:00:07.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.193+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:00:07.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.193+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T15:00:07.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.201+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:00:07.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.241+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:07.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.273+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:00:07.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.273+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:07.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.285+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:00:07.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.317+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:00:07.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.325+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:07.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.325+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:00:07.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.329+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:00:07.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.341+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T15:00:07.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.353+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:00:07.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.365+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:00:07.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 189 16 2065174 2065158 682.863 693.938 0.000621945 0.00145457 2024-09-16T15:00:07.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.373+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:00:07.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.397+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:00:07.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:00:07.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.417+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:07.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.417+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:00:07.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.465+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:00:07.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.469+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:00:07.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.509+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:00:07.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.509+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:07.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.513+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:00:07.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.521+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:00:07.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.545+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:00:07.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.545+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:00:07.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.553+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T15:00:07.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.569+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:00:07.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.569+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:00:07.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.597+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:00:07.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.601+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:00:07.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.621+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:00:07.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.629+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:00:07.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.649+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:00:07.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.665+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:00:07.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.665+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:00:07.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.669+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:00:07.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.681+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:00:07.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:00:07.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.709+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:00:07.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.721+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:07.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.745+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:00:07.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.757+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:00:07.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.781+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:07.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.785+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:00:07.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.785+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:07.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:00:07.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.837+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:00:07.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.845+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T15:00:07.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.853+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:00:07.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.873+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:00:07.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.873+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:00:07.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.889+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T15:00:07.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.905+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:00:07.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.921+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:00:07.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.929+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:00:07.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.961+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T15:00:07.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.965+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:00:07.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.977+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:00:07.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:07.989+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:00:08.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.005+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:00:08.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.025+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:08.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.037+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:00:08.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.057+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:00:08.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.081+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:08.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.117+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:00:08.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.125+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:00:08.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.133+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:00:08.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.149+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:00:08.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.149+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:00:08.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.169+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:00:08.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.209+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:00:08.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.217+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:00:08.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.217+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:08.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.233+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:00:08.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.265+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:00:08.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.265+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:00:08.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.281+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:00:08.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.305+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:00:08.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.313+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:00:08.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.321+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T15:00:08.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.325+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:00:08.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.329+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:00:08.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.337+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:00:08.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.365+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:00:08.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 190 16 2076434 2076418 682.973 703.75 0.000905803 0.00145433 2024-09-16T15:00:08.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.453+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:00:08.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.453+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:00:08.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.457+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:00:08.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.461+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:00:08.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.481+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:00:08.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.501+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:00:08.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.501+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:00:08.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.505+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:00:08.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.533+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:00:08.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.545+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:00:08.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.553+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:00:08.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.573+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:00:08.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.581+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:00:08.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.581+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:00:08.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.593+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:00:08.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.613+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:00:08.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.629+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:00:08.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.633+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:00:08.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.649+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:00:08.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.669+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:00:08.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.673+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:08.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.685+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:00:08.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.725+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:00:08.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.789+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:00:08.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.801+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:08.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.813+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:00:08.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.829+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:00:08.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.833+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:00:08.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.841+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:00:08.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.857+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:00:08.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.869+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:00:08.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.873+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T15:00:08.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.889+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T15:00:08.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.905+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T15:00:08.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.909+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:00:08.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.933+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:00:08.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.941+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T15:00:08.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.945+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:00:08.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.961+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:00:08.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.973+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:08.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.989+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:00:08.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:08.997+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:09.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.013+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:00:09.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.017+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:00:09.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.021+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:00:09.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.033+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T15:00:09.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.061+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:09.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.101+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:09.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.113+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:00:09.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.137+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:00:09.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.161+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:00:09.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.181+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:00:09.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.197+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:00:09.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.197+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:00:09.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.213+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T15:00:09.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.229+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:00:09.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.261+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:00:09.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.277+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:00:09.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.289+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:00:09.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.293+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:00:09.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.301+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:00:09.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.329+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:00:09.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.337+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:00:09.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.361+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:00:09.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 191 16 2087949 2087933 683.165 719.688 0.000824805 0.00145394 2024-09-16T15:00:09.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.381+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T15:00:09.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.389+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T15:00:09.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.389+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:00:09.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.413+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:00:09.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.413+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:00:09.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.421+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:00:09.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.429+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:00:09.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.469+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:09.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.501+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:00:09.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.509+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:00:09.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.513+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T15:00:09.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.545+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:00:09.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.549+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:00:09.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:00:09.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.593+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T15:00:09.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.613+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:00:09.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.625+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:09.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.625+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:09.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.633+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:00:09.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.677+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:00:09.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.693+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:00:09.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.693+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:00:09.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.697+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:00:09.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.709+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:00:09.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.725+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:00:09.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:00:09.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.737+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:00:09.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.737+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:00:09.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.773+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:00:09.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.777+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:00:09.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.781+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:00:09.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.825+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:00:09.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.841+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:00:09.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.853+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:00:09.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.865+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:00:09.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.877+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:09.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.885+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T15:00:09.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.897+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:00:09.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.929+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:00:09.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.937+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:00:09.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.949+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:00:09.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.957+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:00:09.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.973+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:00:09.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:09.981+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:00:10.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.001+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:00:10.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.009+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:10.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.009+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:00:10.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.049+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:00:10.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.081+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:00:10.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.085+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:00:10.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.085+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:00:10.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.105+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:00:10.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.109+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:00:10.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.117+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:00:10.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.121+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:00:10.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.165+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:10.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.165+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T15:00:10.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.173+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:00:10.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.177+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:00:10.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.189+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:10.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.253+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:10.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.257+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:00:10.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.281+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:00:10.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.297+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:00:10.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.317+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:00:10.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.325+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T15:00:10.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:00:10.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.345+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T15:00:10.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.353+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:10.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.369+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:00:10.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 192 16 2098469 2098453 683.031 657.5 0.000937874 0.0014542 2024-09-16T15:00:10.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.373+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:00:10.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.393+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:00:10.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.405+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:00:10.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.405+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:00:10.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.437+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:00:10.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.441+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T15:00:10.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.457+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:00:10.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.489+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:00:10.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.505+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:00:10.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.513+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:00:10.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.525+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:00:10.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.533+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:00:10.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.537+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:00:10.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.545+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:00:10.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.561+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:00:10.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.601+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:00:10.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.609+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:00:10.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.625+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:00:10.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.629+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:00:10.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.641+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T15:00:10.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.657+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:00:10.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.673+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:10.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.693+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:10.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:00:10.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.713+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:00:10.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.721+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:00:10.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.737+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:10.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.749+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:00:10.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.761+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T15:00:10.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.781+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:00:10.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.789+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T15:00:10.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.789+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:00:10.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.797+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T15:00:10.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.817+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:00:10.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.833+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:00:10.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.861+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:00:10.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.869+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:00:10.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.897+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:00:10.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.917+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:00:10.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.921+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:00:10.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.925+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:00:10.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.949+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:00:10.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.957+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:00:10.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:10.981+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T15:00:11.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.009+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:11.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.021+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:00:11.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.029+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:00:11.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.041+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T15:00:11.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.069+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:11.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.069+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:00:11.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.097+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:00:11.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.101+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:00:11.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.113+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:00:11.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.121+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:00:11.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.145+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:00:11.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.149+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:00:11.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.157+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T15:00:11.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.181+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:00:11.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.193+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:00:11.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.229+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:00:11.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.229+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:11.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.269+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:00:11.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.281+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:00:11.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.301+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:00:11.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.325+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:00:11.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.325+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:00:11.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.329+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:00:11.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.353+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:00:11.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.353+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:00:11.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 193 15 2109504 2109489 683.065 689.75 0.00144673 0.00145413 2024-09-16T15:00:11.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.377+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:00:11.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.397+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:00:11.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.401+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:00:11.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.433+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:00:11.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.453+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:00:11.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.453+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:00:11.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.453+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:11.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.457+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:00:11.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.473+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:00:11.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.501+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:00:11.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.513+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:00:11.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.545+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:00:11.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.557+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:11.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.565+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:00:11.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.589+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T15:00:11.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.605+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:11.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.613+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:00:11.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.613+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:00:11.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.641+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:00:11.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.649+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:11.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.657+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:00:11.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.689+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:00:11.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.693+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T15:00:11.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.713+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:00:11.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.737+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T15:00:11.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.757+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:00:11.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.777+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:00:11.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.797+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:00:11.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.801+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:00:11.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.873+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:00:11.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.877+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:00:11.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.893+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:00:11.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.909+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:00:11.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.913+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:00:11.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.913+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:11.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.961+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:00:11.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.969+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:00:11.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.989+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:11.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.989+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:00:11.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:11.997+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:00:12.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.021+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:00:12.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.041+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:00:12.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.065+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:00:12.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.073+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T15:00:12.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.089+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:00:12.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.121+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:00:12.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.121+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:00:12.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.125+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:00:12.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.149+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:12.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.185+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:12.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.193+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T15:00:12.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.205+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:00:12.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.213+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:00:12.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.233+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:00:12.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.237+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T15:00:12.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.261+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:00:12.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.269+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:00:12.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.289+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:00:12.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.289+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:00:12.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.297+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:00:12.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.313+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:00:12.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.317+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:12.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.325+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:00:12.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.337+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:00:12.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 194 16 2120909 2120893 683.218 712.75 0.000567483 0.00145375 2024-09-16T15:00:12.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.385+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:12.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:00:12.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.417+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:00:12.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.417+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:00:12.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.425+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T15:00:12.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.425+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:12.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.437+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:00:12.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.465+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:00:12.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.469+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:00:12.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.481+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:00:12.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.509+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:00:12.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.517+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:00:12.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.517+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:00:12.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.561+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:12.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.589+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:00:12.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.605+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:00:12.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.605+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:00:12.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.609+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:00:12.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.633+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:00:12.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.649+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:00:12.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.649+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:00:12.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.661+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:00:12.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.681+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:00:12.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.693+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:12.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.709+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T15:00:12.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.729+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:00:12.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.737+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:00:12.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.777+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:00:12.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.801+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:00:12.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.809+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:00:12.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.813+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T15:00:12.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.817+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:00:12.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.849+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:00:12.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.861+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:00:12.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.877+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:00:12.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.913+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:00:12.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.925+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:00:12.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.933+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:00:12.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.989+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:00:12.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:12.997+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:00:13.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.021+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:00:13.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.025+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:00:13.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.025+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:00:13.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.053+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:00:13.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.061+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:00:13.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.069+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:00:13.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.089+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:00:13.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.109+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:00:13.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.117+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:13.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.125+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:00:13.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.141+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:00:13.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.149+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:00:13.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.153+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T15:00:13.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.165+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:00:13.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.185+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:00:13.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.205+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:00:13.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.213+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:13.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.225+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:00:13.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.241+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:00:13.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.285+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:00:13.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.309+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:00:13.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.321+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:00:13.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.333+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:00:13.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.357+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:00:13.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.361+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:00:13.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.365+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:00:13.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 195 16 2132249 2132233 683.349 708.75 0.000586176 0.00145353 2024-09-16T15:00:13.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.389+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T15:00:13.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.389+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:00:13.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.401+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:13.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.417+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:00:13.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.425+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:00:13.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.437+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:00:13.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.441+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T15:00:13.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.457+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:13.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.473+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:00:13.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.485+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T15:00:13.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.517+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:00:13.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.517+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:13.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.541+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:00:13.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:00:13.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.609+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:00:13.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.613+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T15:00:13.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.673+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:00:13.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.673+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:00:13.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.677+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:00:13.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.681+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:00:13.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.685+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:00:13.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.737+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T15:00:13.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.749+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T15:00:13.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.765+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:13.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.765+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:00:13.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.793+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:00:13.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.821+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:00:13.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.853+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:13.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.865+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:00:13.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.877+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:00:13.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.881+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:13.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.881+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:00:13.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.881+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:00:13.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.901+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:00:13.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.913+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:00:13.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.957+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:00:13.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.957+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:00:13.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.969+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:00:13.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:13.977+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:00:14.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.009+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:00:14.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.013+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:00:14.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.017+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T15:00:14.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.041+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:00:14.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.045+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:00:14.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.061+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:00:14.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.089+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T15:00:14.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.089+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:00:14.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.097+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:00:14.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.105+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:00:14.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.133+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:00:14.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.141+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:00:14.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.145+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:14.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.153+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:00:14.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.189+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:00:14.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.205+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:14.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.217+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:00:14.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.233+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:00:14.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.233+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:00:14.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.241+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:00:14.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.261+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:00:14.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.285+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:00:14.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.285+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:14.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.293+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:00:14.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.313+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:00:14.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.341+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:00:14.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.349+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:00:14.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.353+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:00:14.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.357+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:00:14.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.365+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:14.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 196 16 2143459 2143443 683.437 700.625 0.000682283 0.00145333 2024-09-16T15:00:14.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.409+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:00:14.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.413+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:00:14.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.429+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T15:00:14.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.449+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:00:14.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.453+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:00:14.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.461+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:00:14.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.465+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:00:14.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.469+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:00:14.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.493+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:00:14.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.493+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:00:14.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.513+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T15:00:14.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.517+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:00:14.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.569+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:00:14.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.589+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:14.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.605+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:00:14.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.633+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:00:14.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.649+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:00:14.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.685+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:00:14.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.689+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T15:00:14.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.689+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:14.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.713+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:00:14.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.725+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:00:14.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.737+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:00:14.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.773+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:00:14.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.773+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:00:14.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.789+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:00:14.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.797+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:00:14.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.813+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T15:00:14.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.813+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:14.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.817+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:00:14.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.833+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:00:14.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.841+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:00:14.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.849+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:00:14.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.853+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:00:14.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.877+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:00:14.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.885+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:14.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.905+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:00:14.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.909+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:00:14.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.921+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:00:14.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.941+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:00:14.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.969+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T15:00:14.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.973+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T15:00:14.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:14.989+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:00:15.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.009+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:15.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.021+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:00:15.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.033+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:00:15.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.037+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:00:15.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.045+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:00:15.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.069+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:00:15.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.081+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T15:00:15.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.097+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:00:15.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.109+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:00:15.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.129+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:00:15.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.141+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:00:15.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.149+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:00:15.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.153+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:00:15.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.165+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:00:15.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.177+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:00:15.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.193+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:00:15.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.233+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:15.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.237+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T15:00:15.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.241+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:00:15.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.249+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:00:15.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.265+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:00:15.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.277+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:00:15.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.281+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:00:15.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.293+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:00:15.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.305+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:00:15.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.305+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:00:15.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.317+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:00:15.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.353+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:00:15.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.361+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:00:15.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 197 16 2153455 2153439 683.139 624.75 0.000726488 0.00145398 2024-09-16T15:00:15.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.377+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:15.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.397+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:00:15.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:00:15.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.437+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:00:15.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.457+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:00:15.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.461+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:00:15.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.465+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:00:15.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.493+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:00:15.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.501+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T15:00:15.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.509+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:00:15.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.517+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:00:15.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.525+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:15.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.525+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:00:15.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.545+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:00:15.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.577+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:15.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.593+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:00:15.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.605+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:00:15.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.609+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:00:15.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.633+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:00:15.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.645+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:00:15.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.649+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:00:15.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.665+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:15.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:00:15.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.685+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:00:15.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.697+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:00:15.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.713+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:00:15.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.737+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:00:15.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.765+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:00:15.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.777+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:00:15.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.801+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:00:15.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.813+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:00:15.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.813+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:00:15.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.837+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:00:15.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.853+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:00:15.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.865+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:00:15.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.865+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:00:15.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.877+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:00:15.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.881+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:00:15.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.905+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:00:15.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.909+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:00:15.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.917+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:15.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.933+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:00:15.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.945+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:00:15.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.965+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:00:15.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.973+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:00:15.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:15.977+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:00:16.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.005+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:00:16.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.009+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:00:16.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.017+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:00:16.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.037+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:00:16.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.049+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:00:16.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.061+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:00:16.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.065+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:00:16.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.069+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:00:16.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.073+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T15:00:16.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.093+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:00:16.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.121+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:00:16.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.133+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:00:16.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.161+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:00:16.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.161+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:00:16.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.169+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T15:00:16.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.173+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:00:16.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.193+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:00:16.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.201+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:00:16.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.233+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:00:16.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.237+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:00:16.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.261+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:00:16.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.281+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:00:16.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.285+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:00:16.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.297+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:00:16.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.305+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:00:16.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.313+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:00:16.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.313+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:00:16.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.341+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:16.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.361+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:00:16.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.369+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:00:16.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.369+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:00:16.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 198 15 2164227 2164212 683.089 673.312 0.00182076 0.00145408 2024-09-16T15:00:16.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.417+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T15:00:16.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.421+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:00:16.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.421+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:00:16.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.433+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T15:00:16.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.441+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:00:16.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.445+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:00:16.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.477+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:00:16.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.497+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:00:16.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.509+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:00:16.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.517+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:00:16.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.529+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:00:16.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.537+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T15:00:16.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.549+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:00:16.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.569+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:00:16.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.597+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:00:16.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.613+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:16.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.617+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:00:16.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.621+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T15:00:16.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.661+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:00:16.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.661+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:00:16.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.665+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:00:16.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.713+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:00:16.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.725+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:00:16.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.745+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T15:00:16.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.757+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:00:16.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.757+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:00:16.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.777+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:00:16.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.789+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:00:16.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.805+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:16.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.813+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:00:16.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.825+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:00:16.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.877+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:00:16.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.885+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:16.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.889+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:00:16.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.889+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:00:16.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.905+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:00:16.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.937+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:00:16.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.949+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:00:16.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.957+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:00:16.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.977+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T15:00:16.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:16.993+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:00:17.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.009+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:00:17.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.025+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:00:17.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.025+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:00:17.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.033+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:17.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.049+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:00:17.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.053+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:00:17.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.069+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:00:17.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.081+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:00:17.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.081+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:00:17.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.117+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:00:17.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.133+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:00:17.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.133+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:00:17.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.137+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:00:17.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.141+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:00:17.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.185+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:00:17.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.197+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:00:17.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.201+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:00:17.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.209+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:00:17.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.209+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:00:17.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.265+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T15:00:17.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.265+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:00:17.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.265+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:00:17.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.285+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:00:17.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.293+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:00:17.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.305+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:00:17.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.345+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:00:17.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.345+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:00:17.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.357+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:00:17.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 199 15 2174622 2174607 682.92 649.688 0.00062034 0.00145445 2024-09-16T15:00:17.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.381+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:00:17.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.385+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:00:17.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.397+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:17.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.425+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T15:00:17.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.445+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T15:00:17.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.445+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:00:17.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.493+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:00:17.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.509+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:00:17.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.517+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:00:17.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.533+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:00:17.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.533+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:00:17.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.553+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:00:17.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.597+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:00:17.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.609+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:00:17.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.617+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:00:17.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.629+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:00:17.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.645+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:00:17.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.657+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:00:17.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.661+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:00:17.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.673+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:00:17.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.717+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:17.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.725+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:00:17.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.749+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:00:17.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.753+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:17.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.765+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:00:17.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.769+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:00:17.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.793+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:17.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.793+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:00:17.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.809+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:00:17.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.829+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:00:17.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.833+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:00:17.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.845+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:00:17.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.849+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T15:00:17.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.877+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:17.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.885+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:00:17.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.909+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:00:17.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.929+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:00:17.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.949+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:00:17.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.957+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:00:17.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.961+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:00:17.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:17.965+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:00:18.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.005+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:00:18.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.009+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:00:18.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.013+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:00:18.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.029+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:00:18.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.045+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T15:00:18.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.057+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:00:18.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.061+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:00:18.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.077+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:00:18.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.097+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:00:18.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.121+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:00:18.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.125+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T15:00:18.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.149+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:00:18.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.161+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:00:18.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.161+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T15:00:18.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.181+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:18.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.197+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T15:00:18.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.205+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:00:18.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.205+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:00:18.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.209+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:00:18.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.213+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:18.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.253+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:00:18.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.269+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:00:18.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.289+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:00:18.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.289+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:00:18.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.317+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:00:18.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.317+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:18.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.349+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:00:18.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:00:18.372839+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.00145458 2024-09-16T15:00:18.372 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:00:18.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 200 15 2185375 2185360 682.866 672.062 0.00253809 0.00145458 2024-09-16T15:00:18.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.385+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:00:18.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.389+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:00:18.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.413+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:00:18.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.417+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:00:18.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.445+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:00:18.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.481+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:00:18.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.481+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:00:18.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.485+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:18.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.497+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T15:00:18.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.529+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:00:18.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.533+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:00:18.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.545+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:00:18.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.585+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T15:00:18.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.593+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:00:18.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.597+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:00:18.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.617+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:00:18.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.625+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:00:18.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.645+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:00:18.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.653+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:18.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.657+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:00:18.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.673+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:00:18.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.713+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:00:18.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.713+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:00:18.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.717+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:00:18.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.729+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T15:00:18.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.741+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:00:18.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.745+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:00:18.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.769+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:00:18.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.781+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:00:18.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.789+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:00:18.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T15:00:18.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.817+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:00:18.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.833+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:00:18.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.845+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:18.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.853+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:00:18.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.861+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T15:00:18.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.873+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:00:18.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.909+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:00:18.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.921+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:00:18.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.937+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:00:18.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.949+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:00:18.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.965+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:18.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.965+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:00:18.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.969+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:00:18.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:18.981+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:00:19.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.001+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T15:00:19.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.009+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:00:19.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.021+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:00:19.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.037+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:00:19.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.049+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T15:00:19.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.061+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:19.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.069+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:00:19.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.097+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:00:19.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.101+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:00:19.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.109+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:00:19.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.121+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:00:19.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.121+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:19.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.137+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:00:19.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.161+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:00:19.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.229+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:19.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.249+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T15:00:19.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.265+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:00:19.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.277+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:00:19.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.277+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:00:19.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.281+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:00:19.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.289+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:00:19.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.325+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:00:19.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.329+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:00:19.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.333+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T15:00:19.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.341+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:00:19.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.349+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T15:00:19.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 201 16 2196516 2196500 682.932 696.25 0.000633694 0.00145443 2024-09-16T15:00:19.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.389+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T15:00:19.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.409+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T15:00:19.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.413+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:19.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.429+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:00:19.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.441+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:00:19.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.449+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:19.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.449+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:00:19.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.485+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:00:19.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.577+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:00:19.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.593+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:00:19.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.601+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T15:00:19.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.625+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:00:19.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.641+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:00:19.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.661+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:00:19.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.661+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:00:19.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.681+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:00:19.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.713+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:00:19.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.725+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:00:19.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.729+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:00:19.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.753+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:00:19.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.765+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:00:19.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.773+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:00:19.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.781+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T15:00:19.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.797+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:00:19.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.821+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T15:00:19.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.849+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:00:19.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.881+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:19.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.885+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T15:00:19.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.889+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:00:19.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.917+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:19.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.921+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:00:19.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.933+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T15:00:19.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.949+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:00:19.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.961+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:00:19.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:19.997+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:00:20.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.005+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:00:20.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.021+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T15:00:20.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.049+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:00:20.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.053+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:00:20.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.061+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:00:20.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.089+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:20.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.093+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:00:20.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.117+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T15:00:20.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.125+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:00:20.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.133+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:00:20.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.165+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:00:20.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.169+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:20.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.181+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:00:20.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.197+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:00:20.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.209+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:00:20.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.225+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:20.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.225+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:00:20.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.229+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:00:20.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.237+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:00:20.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.281+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:00:20.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.285+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T15:00:20.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.293+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:00:20.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.305+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:00:20.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.329+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:00:20.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.329+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:00:20.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.341+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:00:20.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 202 16 2206113 2206097 682.52 599.812 0.000796254 0.00145532 2024-09-16T15:00:20.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.377+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:00:20.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.405+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T15:00:20.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.413+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:00:20.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.437+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:00:20.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.445+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:00:20.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.449+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:00:20.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.457+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:00:20.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.469+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:00:20.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.477+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:00:20.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.481+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:00:20.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.513+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:00:20.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.521+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:00:20.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.529+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T15:00:20.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.537+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:00:20.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.549+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:00:20.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.589+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:00:20.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.621+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:00:20.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.625+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:00:20.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.629+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T15:00:20.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.641+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:00:20.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.661+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:00:20.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.681+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:00:20.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.685+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:00:20.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.689+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:00:20.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:00:20.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.717+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:00:20.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.717+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:00:20.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.737+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:00:20.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.737+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:00:20.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.749+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:00:20.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.769+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:00:20.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.789+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:00:20.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.825+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:00:20.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.829+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:00:20.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.853+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:00:20.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.857+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:00:20.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.861+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:00:20.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.881+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T15:00:20.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.889+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T15:00:20.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.905+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:00:20.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.909+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T15:00:20.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.933+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T15:00:20.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.969+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T15:00:20.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.973+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:00:20.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:20.985+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:00:21.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.009+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:00:21.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.029+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:00:21.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.057+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:00:21.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.089+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:00:21.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.109+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:00:21.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.121+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:00:21.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.141+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:00:21.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.145+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:00:21.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.157+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T15:00:21.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.165+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:00:21.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.169+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:00:21.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.201+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:00:21.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.221+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:21.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.233+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:00:21.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.245+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T15:00:21.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.273+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:00:21.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.289+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T15:00:21.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.293+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T15:00:21.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.301+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:21.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.301+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T15:00:21.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.321+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:21.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.361+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:00:21.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 203 16 2216688 2216672 682.414 660.938 0.000989268 0.00145555 2024-09-16T15:00:21.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.385+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:00:21.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.393+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:00:21.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.417+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:00:21.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.421+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:00:21.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.425+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:00:21.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.437+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:00:21.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.465+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:00:21.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.481+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:00:21.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.497+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:00:21.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.509+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:21.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.509+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:21.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.533+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:21.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.533+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:00:21.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.533+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:00:21.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.545+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:00:21.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.553+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:00:21.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.593+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:00:21.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.597+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:00:21.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.605+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T15:00:21.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.625+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T15:00:21.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.645+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:00:21.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.661+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:00:21.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.665+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:00:21.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.669+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T15:00:21.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.677+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:00:21.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:00:21.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.717+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T15:00:21.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.737+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:21.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.745+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:21.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.757+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:00:21.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.761+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T15:00:21.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.789+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:21.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:00:21.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.821+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51381217:::benchmark_data_smithi116_28801_object1288:head, will try copies on 3,4 2024-09-16T15:00:21.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.825+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:00:21.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.825+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:21.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.841+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:00:21.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.869+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:00:21.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.881+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:00:21.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.893+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:00:21.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.905+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:00:21.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.905+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:21.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.925+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:00:21.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.929+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:00:21.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.961+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:00:21.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.973+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:00:21.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.981+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:00:21.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.981+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:00:21.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.993+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T15:00:22.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:21.997+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:00:22.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.049+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:22.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.065+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:00:22.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.069+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:00:22.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.093+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:00:22.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.113+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:00:22.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.117+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:00:22.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.121+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:00:22.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.121+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:00:22.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.125+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:00:22.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.157+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:00:22.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.157+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:00:22.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.165+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T15:00:22.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.205+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:00:22.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.209+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:00:22.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.213+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:22.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.233+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:00:22.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.245+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:00:22.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.245+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:00:22.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.253+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:00:22.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.269+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:00:22.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.325+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:00:22.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.341+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:00:22.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.345+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T15:00:22.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.349+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:00:22.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.353+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:00:22.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.369+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:00:22.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 204 15 2227333 2227318 682.33 665.375 0.000752222 0.00145571 2024-09-16T15:00:22.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.385+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T15:00:22.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.401+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:22.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.421+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:00:22.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.445+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:00:22.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.469+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:00:22.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.473+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:00:22.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:00:22.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.541+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:00:22.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.541+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:00:22.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.565+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:00:22.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.569+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:00:22.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.589+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T15:00:22.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.597+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:00:22.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.609+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:00:22.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.609+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T15:00:22.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.637+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:00:22.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.657+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:00:22.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.661+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:00:22.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.669+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:00:22.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.701+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:00:22.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.713+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:00:22.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.725+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:00:22.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.757+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:00:22.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.777+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:22.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.793+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T15:00:22.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.817+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T15:00:22.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.817+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:22.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.841+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:00:22.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.873+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:22.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.905+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:00:22.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.909+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:22.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.925+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:00:22.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.925+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:22.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.941+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:00:22.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.941+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:00:22.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.961+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:00:22.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.973+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:00:22.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:22.973+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:00:23.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.017+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:00:23.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.017+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:00:23.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.017+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T15:00:23.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.037+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:00:23.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.045+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:00:23.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.053+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T15:00:23.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.085+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:23.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.085+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:00:23.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.113+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T15:00:23.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.113+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:00:23.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.121+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:00:23.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.133+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:00:23.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.145+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:00:23.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.153+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:00:23.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.169+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:00:23.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.185+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:00:23.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.193+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:00:23.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.221+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:00:23.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.237+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:00:23.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.261+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:00:23.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.269+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:00:23.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.289+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:00:23.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.293+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T15:00:23.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.305+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:00:23.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.309+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:00:23.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.325+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:00:23.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.325+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:00:23.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.341+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:00:23.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.365+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:00:23.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 205 16 2238449 2238433 682.39 694.688 0.000792854 0.00145559 2024-09-16T15:00:23.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.373+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:00:23.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.405+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:00:23.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.409+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:00:23.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.409+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:00:23.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.409+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T15:00:23.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.437+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:23.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.441+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:00:23.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.461+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:00:23.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.465+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:00:23.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.465+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:00:23.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.501+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:23.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.509+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:00:23.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.509+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:00:23.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.513+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:00:23.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.553+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:00:23.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.577+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:00:23.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.601+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:00:23.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.613+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:00:23.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.625+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:00:23.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.629+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:00:23.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.637+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:00:23.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.669+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T15:00:23.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.693+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:00:23.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.697+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:00:23.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.709+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:00:23.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.729+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T15:00:23.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.745+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:00:23.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.793+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:23.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.801+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:00:23.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.809+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:23.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.813+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:00:23.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.845+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:00:23.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.853+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:00:23.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.857+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:00:23.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.881+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:00:23.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.905+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:00:23.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.933+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:00:23.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.937+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T15:00:23.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.941+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:00:23.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.945+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:00:23.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.957+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:00:23.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.981+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:00:23.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:23.993+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:00:24.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.021+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:00:24.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.029+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:00:24.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.045+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:00:24.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.069+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T15:00:24.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.089+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:00:24.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.093+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:00:24.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.109+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:00:24.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.113+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:00:24.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.125+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:00:24.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.145+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:00:24.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.149+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:00:24.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.153+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T15:00:24.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.173+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:00:24.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.177+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:00:24.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.185+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:00:24.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.189+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:00:24.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.197+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:00:24.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.241+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:00:24.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.249+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:24.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.257+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T15:00:24.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.273+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:00:24.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.273+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:00:24.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.317+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:00:24.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.329+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:00:24.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.341+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:00:24.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.357+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:00:24.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.365+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:00:24.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 206 16 2249269 2249253 682.36 676.25 0.000476714 0.00145566 2024-09-16T15:00:24.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.385+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:00:24.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.385+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:00:24.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.389+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:00:24.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.405+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:00:24.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.413+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:00:24.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.433+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:00:24.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.465+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:00:24.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.469+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:00:24.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.481+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:00:24.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.485+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:00:24.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.493+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:00:24.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.517+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:00:24.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.521+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:24.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.529+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:00:24.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.545+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:00:24.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.585+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:00:24.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.589+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:00:24.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.593+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:00:24.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.597+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:00:24.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.637+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:00:24.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.645+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:00:24.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.649+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:00:24.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.669+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T15:00:24.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.697+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:00:24.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.701+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:00:24.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.713+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:00:24.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.733+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:00:24.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.741+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T15:00:24.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.788+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:00:24.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.788+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:24.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.796+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:00:24.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.800+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:00:24.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.816+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:00:24.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.836+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:00:24.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.840+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T15:00:24.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.844+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:00:24.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.852+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:00:24.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.860+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:24.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.888+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:00:24.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.924+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:00:24.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.928+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:24.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.932+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:24.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.948+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:24.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.964+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:00:24.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.980+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:00:24.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.984+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:00:24.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:24.992+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T15:00:25.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.004+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:25.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.024+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:00:25.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.040+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:00:25.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:25.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.076+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T15:00:25.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.076+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T15:00:25.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.104+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:00:25.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.108+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T15:00:25.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.120+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:00:25.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.156+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:00:25.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.164+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:25.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.172+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:00:25.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.180+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:00:25.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.212+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:00:25.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.224+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:00:25.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.224+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:25.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.232+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:00:25.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.240+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:00:25.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.264+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:00:25.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.292+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:00:25.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.312+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T15:00:25.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.320+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:00:25.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.344+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T15:00:25.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.352+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:00:25.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.356+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:00:25.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 207 16 2259805 2259789 682.245 658.5 0.000445267 0.0014559 2024-09-16T15:00:25.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.388+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:00:25.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.392+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:00:25.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.428+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:00:25.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.432+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:00:25.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.448+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:00:25.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.460+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T15:00:25.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.476+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:00:25.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.476+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:00:25.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.480+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:00:25.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.488+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:00:25.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.508+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:00:25.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.520+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:00:25.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.540+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:00:25.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.560+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:00:25.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.576+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:00:25.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.588+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:00:25.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.620+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:00:25.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.620+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:00:25.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.620+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:00:25.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.636+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:00:25.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.640+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:00:25.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.656+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:00:25.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.664+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:00:25.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.688+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T15:00:25.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.696+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:00:25.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.700+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:00:25.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.716+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:00:25.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.732+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:00:25.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.740+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:00:25.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.856+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:00:25.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.860+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T15:00:25.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.880+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:00:25.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.880+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:00:25.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.916+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:00:25.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.924+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:00:25.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.932+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:00:25.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.956+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:00:25.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.956+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:00:25.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.980+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:00:25.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:25.988+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:00:26.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.004+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:00:26.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.012+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:00:26.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.024+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:26.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.032+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:00:26.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.032+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:00:26.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.056+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:00:26.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.100+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T15:00:26.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.108+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:00:26.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.116+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:00:26.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.120+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:00:26.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.136+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:00:26.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.144+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:00:26.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.148+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:00:26.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.164+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:00:26.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.188+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:00:26.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.208+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:00:26.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.208+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:00:26.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.224+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T15:00:26.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.232+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:26.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.256+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T15:00:26.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.264+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:00:26.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.264+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:00:26.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.268+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T15:00:26.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.320+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:00:26.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.324+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:00:26.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.332+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:00:26.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.332+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:26.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.344+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T15:00:26.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.348+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:00:26.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.352+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:00:26.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 208 16 2269764 2269748 681.957 622.438 0.002812 0.00145651 2024-09-16T15:00:26.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.384+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:00:26.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.388+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:00:26.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.396+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:00:26.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.432+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:00:26.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.444+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:00:26.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.444+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T15:00:26.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.452+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:00:26.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.484+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:26.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.488+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:00:26.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.504+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:00:26.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.516+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:00:26.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.520+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:00:26.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.532+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:00:26.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.548+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:00:26.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.552+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:00:26.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.572+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:00:26.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.596+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:00:26.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.604+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:00:26.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.608+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:00:26.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.632+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:00:26.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.648+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:00:26.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.656+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:00:26.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.660+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T15:00:26.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.664+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:00:26.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.668+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:00:26.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.728+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T15:00:26.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.740+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:26.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.744+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:00:26.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.772+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:00:26.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.772+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:00:26.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.776+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:00:26.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.820+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:00:26.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.828+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:00:26.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.840+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:00:26.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.868+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:00:26.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.868+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:00:26.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.876+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:00:26.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.880+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:00:26.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.924+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:00:26.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.956+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:00:26.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.984+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:00:26.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.988+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:00:26.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.992+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:00:26.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:26.992+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:00:27.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.004+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:00:27.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.024+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:00:27.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.028+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:00:27.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.032+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:00:27.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.036+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:00:27.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.064+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:00:27.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.064+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:00:27.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.096+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:00:27.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.100+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:00:27.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.116+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:27.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.120+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T15:00:27.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.144+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:00:27.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.144+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T15:00:27.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.176+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:00:27.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.188+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:00:27.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.208+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:00:27.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.208+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:00:27.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.220+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:00:27.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.272+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:00:27.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.276+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:00:27.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.288+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:00:27.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.312+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:27.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.324+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:00:27.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.328+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:00:27.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.344+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:00:27.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 209 16 2280652 2280636 681.949 680.5 0.00136162 0.00145654 2024-09-16T15:00:27.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.388+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:00:27.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.388+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:00:27.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.408+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T15:00:27.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.420+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:00:27.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.428+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:27.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.448+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:00:27.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.460+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:27.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.480+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:00:27.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.488+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:00:27.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.496+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:00:27.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.508+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:00:27.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.520+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:00:27.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.544+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:00:27.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.556+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:00:27.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.572+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T15:00:27.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.600+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:00:27.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.616+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:00:27.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.636+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:27.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.648+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:27.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.652+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:00:27.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.660+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:00:27.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.668+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:27.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.668+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:00:27.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.688+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:27.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.692+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:00:27.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.728+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T15:00:27.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.740+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:00:27.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.748+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T15:00:27.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.764+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T15:00:27.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.776+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:27.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.820+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T15:00:27.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.856+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:00:27.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.864+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:00:27.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.864+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:00:27.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.868+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:27.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.880+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:27.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.884+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:00:27.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.940+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:00:27.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.944+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:00:27.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.948+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:00:27.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.952+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:00:27.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.964+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:27.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.988+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:00:28.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:27.996+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:00:28.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.000+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:00:28.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.008+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:00:28.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.056+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:28.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.060+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:00:28.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.060+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:00:28.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.084+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:00:28.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.088+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:00:28.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.088+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T15:00:28.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.096+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:00:28.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.120+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T15:00:28.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.128+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:00:28.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.136+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:00:28.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.164+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:00:28.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.168+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T15:00:28.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.184+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:00:28.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.196+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:00:28.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.224+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:00:28.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.224+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:00:28.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.224+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:00:28.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:00:28.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.304+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:00:28.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.304+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:00:28.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.316+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:00:28.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.320+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:28.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.320+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:00:28.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.336+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:28.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.340+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:00:28.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.344+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:00:28.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.364+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:00:28.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 210 16 2291604 2291588 681.961 684.5 0.000641967 0.00145648 2024-09-16T15:00:28.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.384+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:00:28.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.400+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:00:28.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.420+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:00:28.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.428+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:28.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.452+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:00:28.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.460+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:00:28.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.464+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:00:28.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.480+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:00:28.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.484+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:00:28.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.504+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:00:28.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.512+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:00:28.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.520+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:00:28.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.556+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:00:28.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.572+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:00:28.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.584+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:00:28.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.604+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:00:28.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.608+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:00:28.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.608+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:00:28.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.608+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:00:28.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.684+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:00:28.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.704+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:28.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.720+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:00:28.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.728+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:00:28.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.748+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:00:28.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.776+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:00:28.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.792+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:00:28.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:00:28.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.820+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:00:28.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.844+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:00:28.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.864+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:00:28.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.884+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:00:28.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.884+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:00:28.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.892+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:00:28.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.904+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:00:28.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.916+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:00:28.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.940+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:00:28.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.940+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:00:28.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.964+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:00:28.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.976+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:00:28.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:28.984+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:00:29.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.024+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:00:29.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.040+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:29.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.052+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:00:29.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.068+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:00:29.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.080+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:00:29.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.096+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:00:29.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.128+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:00:29.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.148+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:00:29.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.156+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:00:29.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.164+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:29.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.180+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:00:29.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.184+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:00:29.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.200+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:00:29.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.204+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:00:29.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.224+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:00:29.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.240+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:00:29.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.252+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:00:29.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.260+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:00:29.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.272+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:00:29.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.280+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:00:29.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.288+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:00:29.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.304+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:00:29.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.312+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:00:29.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.312+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:29.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.332+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:00:29.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.344+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:00:29.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 211 16 2302974 2302958 682.097 710.625 0.000930554 0.00145621 2024-09-16T15:00:29.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.376+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:00:29.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.400+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:00:29.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.404+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:00:29.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.428+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:00:29.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.432+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T15:00:29.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.452+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:00:29.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.456+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:00:29.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.472+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:00:29.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.476+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:00:29.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.484+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:00:29.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.508+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:00:29.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.528+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:29.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.540+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:00:29.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.548+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:00:29.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.568+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:00:29.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.592+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T15:00:29.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.592+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:00:29.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.592+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:00:29.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.620+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T15:00:29.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.632+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:29.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.636+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:29.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.668+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:00:29.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.668+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:00:29.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.696+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:00:29.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.700+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:00:29.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.712+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:29.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.720+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:29.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.724+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:00:29.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.768+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:00:29.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.768+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:00:29.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.792+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:00:29.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.796+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:00:29.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.796+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:00:29.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.828+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:29.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.832+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:00:29.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.844+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:00:29.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.872+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T15:00:29.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.876+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:00:29.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.880+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:29.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.880+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:00:29.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.892+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:00:29.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.908+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:00:29.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.968+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:00:29.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.980+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:00:29.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.980+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:00:29.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:29.992+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:00:30.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.012+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:00:30.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.028+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:00:30.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.036+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T15:00:30.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.064+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:00:30.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.068+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:00:30.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.080+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:00:30.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.084+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:00:30.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.088+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T15:00:30.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.128+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:00:30.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.128+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:00:30.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.132+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:30.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.148+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:00:30.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.156+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:00:30.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.160+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:00:30.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.168+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:00:30.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.216+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:00:30.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.220+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:00:30.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.236+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:00:30.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.248+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:00:30.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.256+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:00:30.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.268+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:00:30.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.284+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:00:30.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.288+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:00:30.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.296+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:00:30.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.300+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:30.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 212 15 2314013 2313998 682.134 690 0.000787969 0.00145616 2024-09-16T15:00:30.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.384+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:00:30.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.384+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:00:30.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.388+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:00:30.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.416+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:00:30.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.428+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:00:30.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.428+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:00:30.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.440+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:00:30.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.460+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:00:30.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.488+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T15:00:30.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.488+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:30.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.492+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:30.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.524+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T15:00:30.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.532+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:00:30.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.576+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:00:30.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.588+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:00:30.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.592+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:00:30.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.608+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:00:30.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.616+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:30.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.640+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T15:00:30.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.640+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:00:30.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.648+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:00:30.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.680+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T15:00:30.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.708+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:00:30.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.724+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:00:30.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.752+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:00:30.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.776+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:00:30.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.784+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:00:30.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.816+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:00:30.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.828+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:00:30.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.844+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:00:30.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.852+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:00:30.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.852+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:00:30.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.868+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:00:30.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.916+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:00:30.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.936+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:00:30.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.948+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T15:00:30.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.956+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:00:30.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.956+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:00:30.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:30.976+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:00:31.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.000+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:00:31.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.028+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:31.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.028+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:00:31.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.028+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:31.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.044+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:00:31.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.080+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:00:31.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.088+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:00:31.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.112+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T15:00:31.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.120+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:00:31.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.120+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:00:31.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.132+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:00:31.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.136+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:00:31.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.212+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T15:00:31.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.268+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:31.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.292+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:00:31.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.296+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:00:31.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.308+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:31.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.328+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:31.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.336+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:00:31.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.344+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:00:31.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.360+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:00:31.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.364+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:00:31.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.368+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:31.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 213 16 2324642 2324626 682.05 664.25 0.00187408 0.00145631 2024-09-16T15:00:31.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.400+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:00:31.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.420+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:31.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.444+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:00:31.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.444+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T15:00:31.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.468+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:00:31.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.472+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:00:31.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.512+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:00:31.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.548+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:00:31.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.560+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:00:31.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.568+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:00:31.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.584+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:00:31.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.600+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:00:31.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.612+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:00:31.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.616+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:00:31.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.620+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:00:31.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.652+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:00:31.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.652+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T15:00:31.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.656+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:00:31.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.664+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:00:31.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.688+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:00:31.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.700+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:00:31.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.708+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:31.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.716+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:00:31.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.720+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:00:31.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.736+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T15:00:31.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.764+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:00:31.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.772+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:00:31.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.780+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:00:31.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.792+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:00:31.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.800+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:00:31.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.844+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:00:31.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.860+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:00:31.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.864+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:00:31.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.876+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:00:31.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.880+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:00:31.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.896+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:00:31.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.936+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:00:31.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.940+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:00:31.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.968+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:31.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:31.984+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:00:32.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.004+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:00:32.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.012+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:00:32.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.032+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:00:32.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.060+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:00:32.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.084+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:00:32.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.096+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:00:32.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.100+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:00:32.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.100+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:00:32.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.128+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:00:32.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.144+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:00:32.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.168+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:00:32.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.196+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:00:32.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.204+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:32.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.216+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:00:32.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.228+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:32.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.236+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:00:32.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.268+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:00:32.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.280+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:00:32.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.280+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:00:32.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.288+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:00:32.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.300+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:00:32.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.316+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:00:32.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.340+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:00:32.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.340+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:00:32.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.360+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:00:32.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.360+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:32.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 214 16 2335746 2335730 682.105 694 0.00388767 0.00145619 2024-09-16T15:00:32.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.384+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:00:32.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.400+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:00:32.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.404+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:00:32.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.416+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:00:32.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.416+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:00:32.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.440+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:00:32.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.456+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:00:32.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.460+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T15:00:32.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.464+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:00:32.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.512+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:00:32.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.528+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:00:32.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.536+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:00:32.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.560+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:00:32.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.576+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:00:32.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.576+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:00:32.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.580+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T15:00:32.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.584+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T15:00:32.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.608+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:00:32.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.644+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:00:32.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.664+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:00:32.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.680+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:00:32.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.696+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:00:32.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.716+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:00:32.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.732+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:00:32.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.760+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:00:32.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.760+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T15:00:32.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.760+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T15:00:32.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.772+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:00:32.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.784+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:00:32.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.796+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:00:32.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.796+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:00:32.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.808+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:00:32.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.848+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:00:32.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.856+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:00:32.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.892+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T15:00:32.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.924+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:00:32.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.936+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:00:32.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.948+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:00:32.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.952+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:00:32.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:32.976+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T15:00:33.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.000+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:00:33.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.016+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:00:33.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.032+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:33.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.056+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:00:33.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.060+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:00:33.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.068+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:00:33.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.068+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:00:33.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.076+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:00:33.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.108+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:00:33.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.132+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:00:33.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.132+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:00:33.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.152+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T15:00:33.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.168+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:00:33.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.168+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:00:33.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.180+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:00:33.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.216+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:00:33.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.220+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:00:33.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.236+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:00:33.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.248+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:00:33.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.264+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:00:33.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.272+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:00:33.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.300+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:00:33.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.308+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:00:33.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.320+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:00:33.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.324+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:00:33.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.344+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:00:33.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.352+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:00:33.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.364+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:00:33.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.368+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:00:33.373 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 215 16 2346696 2346680 682.115 684.375 0.000610428 0.00145617 2024-09-16T15:00:33.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.388+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:00:33.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.400+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:00:33.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.428+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:00:33.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.428+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:00:33.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.428+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:00:33.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.464+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:00:33.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.476+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T15:00:33.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.496+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:33.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.496+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:00:33.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.500+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:00:33.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.528+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:00:33.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.540+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:00:33.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.544+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T15:00:33.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.564+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:00:33.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.572+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T15:00:33.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.576+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:00:33.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.616+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:00:33.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.636+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T15:00:33.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.636+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:00:33.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.656+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:00:33.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.656+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:00:33.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.660+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:00:33.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.676+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:00:33.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.676+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:00:33.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.696+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:00:33.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.720+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:00:33.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.760+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:00:33.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.768+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:00:33.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.788+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:00:33.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.816+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T15:00:33.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.824+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:00:33.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.824+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:00:33.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.836+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:00:33.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.848+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:00:33.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.860+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:00:33.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.868+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:00:33.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.876+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:00:33.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.888+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:00:33.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.916+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:33.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.924+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:33.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.940+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T15:00:33.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.948+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:00:33.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.980+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:00:33.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.980+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:00:33.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.988+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:00:33.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:33.992+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:00:34.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.016+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T15:00:34.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.036+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:34.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.064+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:00:34.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.084+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:00:34.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.092+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T15:00:34.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.104+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:00:34.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.124+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:00:34.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.144+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:00:34.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.156+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:00:34.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.168+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:00:34.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.180+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:00:34.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.184+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:00:34.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.188+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:00:34.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.212+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:00:34.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.220+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:00:34.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.228+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:00:34.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.236+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:00:34.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:34.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.284+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:00:34.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.284+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T15:00:34.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.288+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:00:34.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.304+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:00:34.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.304+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:00:34.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.332+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:00:34.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.332+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:00:34.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.344+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:00:34.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 216 16 2357526 2357510 682.091 676.875 0.00152541 0.00145623 2024-09-16T15:00:34.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.372+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:00:34.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.376+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:00:34.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.380+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:34.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.404+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:00:34.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.464+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:00:34.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.472+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:00:34.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.484+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:34.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.492+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:00:34.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.528+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:00:34.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.628+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:00:34.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.696+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:00:34.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.724+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:00:34.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.752+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:00:34.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.752+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:00:34.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.796+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:00:34.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.796+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:00:34.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.816+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:00:34.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.836+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:00:34.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.856+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T15:00:34.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.860+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:00:34.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.876+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T15:00:34.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.884+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:34.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.904+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:00:34.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.904+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:00:34.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.916+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:00:34.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.940+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:00:34.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.968+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:00:34.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.968+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:34.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.984+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:00:35.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:34.996+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:35.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.032+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:35.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.036+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:00:35.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.040+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:35.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.048+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:00:35.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.084+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T15:00:35.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.088+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:00:35.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.136+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:00:35.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.136+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T15:00:35.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.148+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:00:35.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.172+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T15:00:35.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.176+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T15:00:35.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.216+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:00:35.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.220+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:35.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.224+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T15:00:35.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.240+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:00:35.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.240+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:00:35.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.244+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:00:35.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.276+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:35.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.292+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:00:35.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.296+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:35.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.320+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:00:35.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.332+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:00:35.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.352+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T15:00:35.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.352+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:00:35.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.352+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:00:35.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 217 16 2367358 2367342 681.779 614.5 0.00093132 0.00145689 2024-09-16T15:00:35.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.384+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T15:00:35.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.416+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:00:35.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.416+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:00:35.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.432+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:00:35.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.444+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:00:35.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.464+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:00:35.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.468+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:00:35.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.480+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:00:35.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.488+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:00:35.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.500+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:00:35.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.504+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:00:35.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.528+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:00:35.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.556+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:00:35.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.572+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:00:35.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.572+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:00:35.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.584+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:00:35.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.604+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:35.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.620+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:35.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.624+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:00:35.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.628+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:00:35.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.648+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:00:35.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.656+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:00:35.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.664+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:00:35.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.672+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:00:35.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.684+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:00:35.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.720+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T15:00:35.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.724+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T15:00:35.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.736+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:00:35.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.740+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:00:35.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.744+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:00:35.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.776+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:00:35.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.796+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:00:35.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.800+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:00:35.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.812+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:00:35.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.812+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:00:35.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.840+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T15:00:35.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.872+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:00:35.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.872+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:00:35.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.892+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:00:35.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.896+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:00:35.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.900+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:35.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.944+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T15:00:35.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.960+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T15:00:35.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.976+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:00:35.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:35.980+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:00:36.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.004+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:00:36.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.060+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:00:36.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.084+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:00:36.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.084+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:00:36.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.112+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:36.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.132+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T15:00:36.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.140+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:00:36.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.160+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:00:36.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.160+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T15:00:36.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.172+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:00:36.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.184+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T15:00:36.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.192+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:00:36.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.200+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T15:00:36.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.208+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T15:00:36.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.212+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:00:36.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.272+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:00:36.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.320+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:00:36.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.332+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:00:36.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.360+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:00:36.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.368+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:00:36.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 218 16 2377598 2377582 681.587 640 0.000808942 0.0014573 2024-09-16T15:00:36.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.376+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:00:36.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.384+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:36.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.404+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:00:36.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.452+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T15:00:36.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.452+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:36.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.472+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:00:36.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.472+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:00:36.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.480+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T15:00:36.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.492+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:00:36.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.532+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T15:00:36.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.540+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:00:36.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.556+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:00:36.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.568+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:00:36.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.568+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:00:36.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.580+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:00:36.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.592+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:00:36.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.624+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T15:00:36.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.632+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:00:36.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.652+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:00:36.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.692+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:00:36.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.692+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:00:36.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.704+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T15:00:36.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.716+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:00:36.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.716+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:00:36.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.748+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:00:36.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.772+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:00:36.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.780+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:00:36.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.796+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:00:36.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:36.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.820+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:00:36.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.836+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:00:36.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.844+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:00:36.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.848+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:00:36.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.864+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:00:36.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.864+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:36.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.892+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:00:36.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.912+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:00:36.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.928+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:00:36.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.944+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:00:36.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.948+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:00:36.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:36.952+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:37.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.000+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:00:37.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.008+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:37.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.036+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:00:37.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.052+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:00:37.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.052+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:00:37.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.064+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:00:37.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.072+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T15:00:37.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.072+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:00:37.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.084+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T15:00:37.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.104+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:00:37.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.108+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:00:37.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.136+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:00:37.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.148+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:00:37.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.160+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:00:37.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.180+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:00:37.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.200+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:00:37.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.220+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:00:37.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.224+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:00:37.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.244+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:00:37.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.272+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:00:37.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.276+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:00:37.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.292+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:00:37.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.296+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:00:37.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.320+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:00:37.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.340+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:00:37.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.352+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:00:37.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.352+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:37.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 219 16 2388175 2388159 681.493 661.062 0.000744473 0.00145751 2024-09-16T15:00:37.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.384+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:00:37.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.392+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:00:37.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.400+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:00:37.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.408+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:00:37.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.420+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:37.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.456+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:00:37.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.476+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:00:37.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.492+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:00:37.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.500+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:00:37.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.524+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:37.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.528+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:00:37.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.532+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:00:37.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.560+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:00:37.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.560+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:00:37.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.584+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:00:37.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.592+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T15:00:37.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.592+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:00:37.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.600+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:00:37.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.604+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:37.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.648+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:00:37.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.648+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:00:37.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.692+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:00:37.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.720+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T15:00:37.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.720+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:00:37.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.732+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:00:37.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.752+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:00:37.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.772+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:00:37.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.772+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:00:37.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.780+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:00:37.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.780+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:00:37.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.808+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:00:37.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.808+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T15:00:37.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.812+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:00:37.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.824+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:00:37.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.848+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:00:37.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.868+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:00:37.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.892+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:00:37.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.900+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T15:00:37.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.904+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T15:00:37.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.912+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:00:37.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.932+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:00:37.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.972+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:00:37.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:37.992+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:00:38.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.000+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:00:38.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.004+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T15:00:38.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.004+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:00:38.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.012+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:00:38.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.028+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:00:38.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.028+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T15:00:38.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.032+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:00:38.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.060+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:00:38.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.080+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:38.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.120+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:00:38.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.124+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:00:38.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.156+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:38.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.160+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:00:38.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.200+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:00:38.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.204+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:00:38.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.212+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:38.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.224+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:00:38.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.252+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:38.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.256+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:00:38.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.264+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:00:38.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.296+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:00:38.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.300+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:00:38.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.320+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:00:38.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.324+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:00:38.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.332+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:38.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:00:38.374501+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.00145758 2024-09-16T15:00:38.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:00:38.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 220 16 2398996 2398980 681.47 676.312 0.000796705 0.00145758 2024-09-16T15:00:38.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.396+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:00:38.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.420+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:00:38.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.428+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:00:38.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.440+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:38.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.444+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:00:38.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.492+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:00:38.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.496+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:00:38.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.496+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:00:38.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.528+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:38.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.532+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:00:38.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.572+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:00:38.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.576+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:00:38.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.604+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:38.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.620+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:38.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.628+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:00:38.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.652+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:00:38.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.660+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:00:38.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.676+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:38.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.676+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:38.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.680+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:00:38.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.684+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:38.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.692+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:00:38.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.748+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:00:38.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.752+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:00:38.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.768+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:00:38.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.792+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:00:38.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.796+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:00:38.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.796+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:00:38.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.844+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:00:38.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.864+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:00:38.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.872+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:00:38.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.912+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:00:38.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.916+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:00:38.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.916+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T15:00:38.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.924+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:00:38.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.940+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:00:38.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.984+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:00:38.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:38.992+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:00:39.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.012+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T15:00:39.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.020+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:00:39.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.020+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T15:00:39.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.020+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:00:39.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.036+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:00:39.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.052+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:00:39.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.068+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T15:00:39.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.068+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:39.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.092+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:00:39.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.096+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:00:39.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.120+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:00:39.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.128+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:39.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.144+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:00:39.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.152+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T15:00:39.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.196+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T15:00:39.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.216+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:00:39.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.224+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:00:39.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.240+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:00:39.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.240+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:00:39.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.272+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:00:39.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.276+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:00:39.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.296+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:00:39.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.312+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:00:39.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.316+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:39.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.336+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:00:39.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.348+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:00:39.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.356+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:00:39.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.356+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:00:39.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 221 16 2410168 2410152 681.545 698.25 0.000545534 0.0014574 2024-09-16T15:00:39.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.376+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:00:39.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.396+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:39.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.404+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T15:00:39.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.412+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:39.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.416+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:00:39.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.472+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:00:39.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.476+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:00:39.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.476+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:00:39.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.480+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:39.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.516+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:00:39.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.520+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:00:39.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.540+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:00:39.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.584+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:00:39.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.584+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:00:39.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.608+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:00:39.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.636+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:00:39.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.664+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T15:00:39.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.676+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:39.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.716+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:00:39.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.732+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:00:39.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.736+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:00:39.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.764+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:00:39.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.764+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:00:39.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.768+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:00:39.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.780+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:00:39.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.800+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:00:39.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.828+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:00:39.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.832+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:00:39.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.864+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:00:39.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.872+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:39.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.876+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:00:39.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.888+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:00:39.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.896+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T15:00:39.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.916+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:00:39.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.932+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:00:39.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.940+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:00:39.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.944+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T15:00:39.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.956+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:00:39.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.968+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:00:39.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.984+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:00:39.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:39.988+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:40.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.040+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:00:40.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.040+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T15:00:40.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.072+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:00:40.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.096+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:00:40.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.100+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:00:40.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.104+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:00:40.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.108+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:00:40.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.156+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:00:40.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.168+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:00:40.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.172+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:00:40.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.184+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:00:40.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.184+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:00:40.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.184+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:00:40.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.204+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:00:40.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.216+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:00:40.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.220+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:00:40.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.248+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:00:40.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.264+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:00:40.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:00:40.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.320+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:00:40.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.332+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T15:00:40.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.336+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:00:40.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.356+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:00:40.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.360+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:00:40.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.360+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:00:40.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 222 16 2421026 2421010 681.532 678.625 0.000744844 0.00145743 2024-09-16T15:00:40.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.400+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:00:40.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.408+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:00:40.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.412+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:00:40.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.448+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:00:40.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.452+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:00:40.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.468+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:00:40.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.476+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:00:40.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.476+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:40.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.480+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:00:40.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.504+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:00:40.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.504+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:00:40.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.552+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:00:40.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.560+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:00:40.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.564+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:00:40.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.596+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:00:40.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.608+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:00:40.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.620+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:00:40.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.632+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:00:40.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.648+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:00:40.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.652+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:00:40.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.664+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:00:40.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.684+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:00:40.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.696+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:00:40.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.720+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:00:40.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.728+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:40.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.732+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:00:40.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.744+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:00:40.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.748+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:40.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.772+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:00:40.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.804+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:00:40.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.836+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:00:40.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.844+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:00:40.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.856+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:00:40.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.856+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T15:00:40.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.864+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:00:40.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.884+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:00:40.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.888+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:00:40.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.912+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:40.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.912+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:00:40.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.956+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:00:40.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.956+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:00:40.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.964+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:41.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:40.996+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:00:41.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.004+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T15:00:41.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.008+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:00:41.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.008+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T15:00:41.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.028+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:00:41.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.064+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:00:41.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.064+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:00:41.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.092+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:00:41.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.096+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:00:41.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.104+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T15:00:41.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.124+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:00:41.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.140+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:00:41.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.140+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:00:41.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.156+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:41.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.164+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:00:41.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.168+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:00:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.244+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:00:41.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.272+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:00:41.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.276+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:41.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.288+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:00:41.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.292+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:00:41.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.312+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:00:41.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.316+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:00:41.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.360+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:41.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.360+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:00:41.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 223 16 2431509 2431493 681.414 655.188 0.000759973 0.00145769 2024-09-16T15:00:41.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.380+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:41.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.396+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:00:41.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.404+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:00:41.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.432+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:41.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.460+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:00:41.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.464+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:00:41.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.492+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:00:41.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.512+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:00:41.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.536+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:00:41.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.540+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T15:00:41.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.568+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:00:41.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.580+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:00:41.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.596+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:00:41.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.604+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:00:41.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.636+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:00:41.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.656+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:00:41.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.660+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:00:41.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.660+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T15:00:41.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.680+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:00:41.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.712+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:00:41.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.716+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:00:41.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.732+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:41.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.732+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:00:41.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.752+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:00:41.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.764+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:00:41.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.788+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T15:00:41.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.812+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T15:00:41.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.832+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:00:41.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.852+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:00:41.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.856+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:00:41.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.868+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:00:41.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.876+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:00:41.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.896+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:00:41.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.920+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:00:41.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.928+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:00:41.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.928+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:00:41.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.944+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T15:00:41.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.956+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:41.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.968+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:00:41.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:41.980+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:00:42.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.020+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:00:42.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.024+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T15:00:42.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.032+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:00:42.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.040+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T15:00:42.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.048+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:00:42.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.048+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:00:42.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.048+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:00:42.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.080+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:00:42.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.088+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:00:42.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.100+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:00:42.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.120+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T15:00:42.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.136+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T15:00:42.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.164+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:00:42.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.180+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T15:00:42.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.236+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:00:42.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.236+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:42.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.240+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T15:00:42.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.272+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:00:42.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.292+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T15:00:42.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.296+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:00:42.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.316+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:00:42.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.320+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:00:42.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.324+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:00:42.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.324+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:00:42.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 224 16 2442826 2442810 681.529 707.312 0.000599004 0.00145745 2024-09-16T15:00:42.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.372+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T15:00:42.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.376+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:00:42.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.376+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:00:42.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.412+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:42.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.420+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:00:42.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.436+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:00:42.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.468+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:42.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.480+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:42.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.496+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:00:42.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.496+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:00:42.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.524+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:00:42.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.544+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T15:00:42.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.552+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:00:42.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.572+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:00:42.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.580+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:00:42.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.608+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:00:42.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.612+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:00:42.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.612+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:00:42.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.616+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:00:42.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.640+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:00:42.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.656+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:00:42.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.668+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:00:42.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.672+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:00:42.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.692+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:00:42.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.696+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:00:42.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.712+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:00:42.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.728+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:00:42.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.740+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:00:42.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.756+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:00:42.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.760+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:00:42.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.792+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:00:42.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.800+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:42.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.808+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:00:42.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.824+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:00:42.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.848+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:00:42.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.848+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:00:42.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.864+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:00:42.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.872+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:42.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.876+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:00:42.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.892+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:00:42.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.904+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:00:42.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.912+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:00:42.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.952+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:00:42.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.960+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:00:42.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:42.976+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:00:43.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.000+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:00:43.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.008+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:00:43.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.016+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:00:43.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.020+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:00:43.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.032+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:00:43.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.036+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:00:43.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.052+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T15:00:43.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.060+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T15:00:43.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.088+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:00:43.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.100+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T15:00:43.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.108+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:00:43.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.148+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:00:43.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.148+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:00:43.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.188+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:43.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.192+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:00:43.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.200+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:43.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.224+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:00:43.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.232+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:00:43.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.264+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:00:43.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:00:43.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.308+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T15:00:43.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.312+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:43.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.332+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:00:43.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.332+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:00:43.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.336+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:00:43.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.364+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:00:43.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.364+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:00:43.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 225 16 2453751 2453735 681.534 682.812 0.000828522 0.00145743 2024-09-16T15:00:43.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.372+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:00:43.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.392+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T15:00:43.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.424+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:00:43.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.444+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:00:43.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.452+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:00:43.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.468+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:00:43.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.468+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:00:43.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.492+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:00:43.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.508+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:00:43.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.512+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:00:43.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.516+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:00:43.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.528+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:00:43.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.540+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T15:00:43.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.552+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T15:00:43.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.576+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:43.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.576+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:00:43.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.608+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T15:00:43.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.608+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:00:43.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.608+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:00:43.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.624+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:00:43.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.652+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:00:43.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.660+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:00:43.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.664+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:00:43.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.664+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:00:43.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.668+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T15:00:43.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.676+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T15:00:43.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.684+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:00:43.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.704+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:00:43.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.712+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:00:43.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.768+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:00:43.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.780+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:00:43.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.784+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:00:43.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.792+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:00:43.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.812+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:00:43.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.816+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:00:43.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.840+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:43.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.848+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:00:43.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.864+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:00:43.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.908+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:00:43.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.936+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:00:43.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.956+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:00:43.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.960+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:00:43.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.960+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:00:43.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:43.980+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:00:44.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.016+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:00:44.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.024+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:00:44.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.028+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T15:00:44.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.044+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:00:44.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.068+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:00:44.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.088+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:00:44.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.088+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:00:44.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.104+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:00:44.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.112+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:44.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.116+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:00:44.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.128+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:00:44.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.152+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:00:44.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.176+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:00:44.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.184+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:00:44.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.184+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:00:44.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.192+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:00:44.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.212+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T15:00:44.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.220+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:00:44.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.224+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:00:44.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.236+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:00:44.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.264+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:00:44.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.268+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:00:44.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.300+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:00:44.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.308+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T15:00:44.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.312+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:00:44.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.320+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:00:44.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.336+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:00:44.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.356+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T15:00:44.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.356+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:00:44.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 226 16 2464555 2464539 681.506 675.25 0.00151441 0.00145749 2024-09-16T15:00:44.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.380+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:00:44.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.392+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:00:44.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.400+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T15:00:44.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.408+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:00:44.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.408+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:00:44.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.424+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:00:44.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.432+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T15:00:44.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.452+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:00:44.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.464+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:00:44.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.464+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:44.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.484+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:00:44.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.496+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:00:44.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.528+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T15:00:44.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.536+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:44.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.564+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T15:00:44.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.576+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:00:44.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.576+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T15:00:44.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.580+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T15:00:44.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.608+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:00:44.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.616+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:00:44.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.636+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:00:44.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.640+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:00:44.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.664+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:00:44.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.680+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:00:44.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.684+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:00:44.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.720+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:00:44.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.728+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:00:44.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.744+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:00:44.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.744+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:00:44.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.764+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:00:44.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.776+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:44.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.788+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:00:44.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.788+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:00:44.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.800+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:00:44.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.804+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:00:44.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.836+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:00:44.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.868+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:00:44.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.876+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:00:44.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.908+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:44.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.912+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:00:44.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.936+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:44.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.940+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:00:44.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.960+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:00:44.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.976+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:44.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:44.996+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:00:45.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.016+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:00:45.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.032+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:00:45.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.032+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T15:00:45.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.044+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:00:45.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.048+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:45.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.052+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:00:45.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.064+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:00:45.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.120+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:00:45.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.124+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T15:00:45.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.128+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:00:45.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.144+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:00:45.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.188+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:00:45.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.208+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:00:45.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.212+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:00:45.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.232+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T15:00:45.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.240+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:45.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.252+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:00:45.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.284+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:00:45.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.284+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:00:45.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.304+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:00:45.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.312+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:00:45.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.328+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:00:45.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.368+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:00:45.374 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 227 16 2475522 2475506 681.523 685.438 0.000667407 0.00145746 2024-09-16T15:00:45.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.400+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:00:45.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.400+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:45.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.436+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:00:45.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.464+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:00:45.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.464+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:45.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.488+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:00:45.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.500+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:00:45.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.520+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:00:45.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.524+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:00:45.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.536+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:00:45.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.536+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:00:45.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.564+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:00:45.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.580+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:00:45.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.580+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:45.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.592+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:00:45.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.608+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:00:45.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.608+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:00:45.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.628+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:00:45.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.636+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:00:45.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.644+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:00:45.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.656+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:45.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.704+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:00:45.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.716+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:45.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.720+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:00:45.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.736+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:00:45.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.752+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:00:45.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.756+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:00:45.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.760+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:00:45.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.792+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:00:45.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.800+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:00:45.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.808+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:00:45.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.824+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:00:45.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.832+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:00:45.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.832+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T15:00:45.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.844+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:45.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.844+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:00:45.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.868+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:00:45.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.888+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:00:45.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.896+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:00:45.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.904+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:00:45.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.924+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:00:45.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.936+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:00:45.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.952+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:00:45.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.968+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T15:00:45.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.980+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:00:45.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:45.984+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:00:46.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.016+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T15:00:46.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.024+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:00:46.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.052+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:00:46.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.056+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:00:46.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.088+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:00:46.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.104+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:00:46.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.108+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:00:46.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.124+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:46.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.136+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:00:46.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.200+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:00:46.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.208+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:00:46.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.208+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:46.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.220+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:00:46.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.236+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:00:46.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.240+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T15:00:46.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.272+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:00:46.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.300+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:00:46.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.328+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:00:46.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.332+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:00:46.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.332+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:00:46.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.344+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:00:46.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 228 15 2486838 2486823 681.636 707.312 0.00109113 0.00145721 2024-09-16T15:00:46.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.384+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:46.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.384+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:00:46.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.388+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:00:46.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.404+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:00:46.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.412+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:00:46.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.420+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:00:46.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.452+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:00:46.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.464+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:00:46.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.484+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:00:46.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.492+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T15:00:46.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.508+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:00:46.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.512+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:00:46.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.524+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T15:00:46.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.536+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:00:46.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.556+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:00:46.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.556+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:00:46.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.612+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:46.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.616+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:00:46.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.624+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:00:46.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.632+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:00:46.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.644+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:00:46.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.660+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:00:46.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.708+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:00:46.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.712+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:00:46.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.720+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:00:46.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.736+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:00:46.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.740+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:00:46.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.740+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:00:46.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.772+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:00:46.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.776+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:00:46.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.792+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:00:46.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.828+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:00:46.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.836+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:00:46.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.840+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:00:46.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.884+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T15:00:46.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.888+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:00:46.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.896+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:00:46.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.904+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:00:46.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.936+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:00:46.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.952+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:00:46.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.956+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:00:46.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.972+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:00:46.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:46.980+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:00:47.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.016+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:47.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.016+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:00:47.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.020+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:00:47.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.020+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:00:47.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.068+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:00:47.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.072+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:00:47.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.104+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T15:00:47.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.152+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:00:47.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.168+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:00:47.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.172+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:00:47.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.200+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:00:47.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.204+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:00:47.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.244+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:00:47.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.252+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:00:47.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.272+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:47.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.284+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:00:47.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.308+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:47.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.328+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T15:00:47.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.344+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:00:47.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.344+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:00:47.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.348+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:00:47.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.352+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:47.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 229 16 2498133 2498117 681.742 705.875 0.000640013 0.00145696 2024-09-16T15:00:47.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.372+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:47.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.384+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:00:47.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.408+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:00:47.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.408+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:47.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.460+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:00:47.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.460+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:00:47.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.468+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:00:47.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.500+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:00:47.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.528+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:00:47.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.528+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:00:47.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.532+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:00:47.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.552+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:00:47.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.572+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T15:00:47.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.580+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:00:47.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.608+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:00:47.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.608+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T15:00:47.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.620+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:00:47.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.632+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:00:47.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.640+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:00:47.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.652+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:00:47.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.664+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:00:47.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.680+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:00:47.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.712+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:00:47.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.740+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:47.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.764+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:00:47.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.792+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:00:47.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.804+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:00:47.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.808+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:00:47.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.816+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:00:47.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.824+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:00:47.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.832+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:00:47.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.892+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T15:00:47.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.908+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:00:47.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.920+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:00:47.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.936+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:00:47.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.976+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:00:47.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:47.976+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:00:48.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.004+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T15:00:48.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.012+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:48.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.012+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:00:48.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.028+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:00:48.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.048+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:00:48.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.060+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:00:48.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.072+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:00:48.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.072+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:00:48.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.076+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:00:48.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.096+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:00:48.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.108+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:00:48.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.148+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:00:48.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.152+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:00:48.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.160+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:00:48.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.184+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:00:48.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.212+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:00:48.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.220+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:00:48.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.236+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:00:48.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.244+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:00:48.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.264+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:00:48.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.268+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:00:48.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.292+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:00:48.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.308+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:00:48.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.308+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:00:48.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.320+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:00:48.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.344+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:00:48.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.356+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:00:48.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.364+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:00:48.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 230 15 2509436 2509421 681.849 706.5 0.000742147 0.00145675 2024-09-16T15:00:48.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.396+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T15:00:48.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.416+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:00:48.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.416+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:00:48.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.428+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:00:48.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.460+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T15:00:48.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.480+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:00:48.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.500+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:00:48.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.540+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:00:48.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.552+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T15:00:48.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.560+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:00:48.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.564+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:48.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.580+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:00:48.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.604+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:00:48.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.632+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:00:48.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.632+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:00:48.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.656+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:00:48.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.672+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:00:48.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.676+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:00:48.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.684+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:00:48.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.712+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:00:48.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.716+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:00:48.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.716+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:00:48.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.720+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:00:48.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.724+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:00:48.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.752+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:00:48.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.764+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T15:00:48.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.800+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:00:48.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.808+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:48.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.832+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:00:48.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.840+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:00:48.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.856+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:00:48.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.892+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:00:48.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.908+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:00:48.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.912+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:00:48.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.948+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:00:48.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.952+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:00:48.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.968+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T15:00:48.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.968+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:00:49.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:48.996+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:00:49.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.000+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:00:49.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.012+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:00:49.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.016+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:00:49.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.032+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:00:49.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.052+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:00:49.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.072+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:00:49.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.084+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:49.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.084+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:00:49.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.096+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:00:49.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.096+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:00:49.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.132+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:00:49.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.156+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:00:49.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.160+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:00:49.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.164+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:00:49.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.192+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:00:49.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.196+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:00:49.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.220+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:00:49.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.220+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:00:49.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.248+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:00:49.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.248+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:00:49.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.256+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:00:49.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.256+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:00:49.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.292+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:00:49.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.324+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:49.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.332+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:00:49.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.348+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:00:49.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.356+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:00:49.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 231 16 2521016 2521000 682.03 723.688 0.000748965 0.00145637 2024-09-16T15:00:49.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.392+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:00:49.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.396+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:49.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.428+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:00:49.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.436+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:00:49.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.456+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:00:49.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.472+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:00:49.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.476+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:49.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.516+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:00:49.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.520+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:00:49.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.524+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:00:49.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.540+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:00:49.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.564+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:00:49.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.568+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:00:49.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.592+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:00:49.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.608+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:00:49.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.616+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:00:49.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.636+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:00:49.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.644+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:00:49.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.648+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:49.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.652+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:00:49.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.672+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:00:49.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.684+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:00:49.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.696+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:00:49.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.700+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:00:49.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.728+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:00:49.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.736+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:00:49.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.748+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:00:49.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.756+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:00:49.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.768+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:00:49.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.788+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:00:49.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.788+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:00:49.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.792+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:00:49.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.820+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:00:49.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.848+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:00:49.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.848+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:00:49.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.876+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:49.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.880+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:00:49.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.916+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:00:49.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.932+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:00:49.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.940+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:00:49.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.952+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:00:49.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.968+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:00:49.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.976+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:00:49.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:49.980+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:00:50.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.004+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T15:00:50.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.008+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:00:50.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.048+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:00:50.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.068+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:00:50.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.072+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:00:50.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.088+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T15:00:50.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.096+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:00:50.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.120+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:00:50.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.128+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:00:50.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.128+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:00:50.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.140+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:00:50.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.148+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:00:50.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.176+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T15:00:50.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.184+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:50.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.196+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:00:50.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.200+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:00:50.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.204+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:00:50.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.228+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:00:50.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.256+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:00:50.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:00:50.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.264+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:00:50.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.276+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:00:50.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.304+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:00:50.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.312+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:00:50.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.328+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:50.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.332+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:00:50.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.340+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:00:50.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.352+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T15:00:50.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.368+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:00:50.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 232 16 2531537 2531521 681.924 657.562 0.00439379 0.00145659 2024-09-16T15:00:50.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.380+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:50.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.396+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T15:00:50.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.400+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:00:50.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.404+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:50.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.432+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:00:50.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.448+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:50.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.452+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:00:50.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.464+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:00:50.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.496+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:00:50.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.516+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T15:00:50.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.520+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:00:50.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.544+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T15:00:50.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.544+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:00:50.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.548+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:00:50.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.556+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:00:50.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.564+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:00:50.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.572+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:00:50.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.604+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:00:50.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.620+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:00:50.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.624+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T15:00:50.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.644+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:00:50.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.668+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T15:00:50.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.700+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:00:50.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.712+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:00:50.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.732+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T15:00:50.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.736+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:00:50.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.748+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:00:50.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.776+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:00:50.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.800+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:00:50.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.804+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:00:50.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.808+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T15:00:50.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.820+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:00:50.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.832+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:50.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.856+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:00:50.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.860+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:00:50.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.876+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:00:50.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.876+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:00:50.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.884+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:50.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.900+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:00:50.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.904+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:00:50.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.920+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:50.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.940+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:00:50.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.980+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:50.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.992+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:00:50.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.992+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:00:50.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:50.996+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:00:51.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.008+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:00:51.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.032+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:00:51.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.040+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:51.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.108+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:00:51.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.116+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:00:51.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.140+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:00:51.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.148+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:00:51.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.148+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:00:51.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.172+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:00:51.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.192+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T15:00:51.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.200+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:00:51.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.208+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:00:51.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.208+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:00:51.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.228+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:00:51.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.268+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:51.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.272+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:00:51.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.280+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:00:51.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.316+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:00:51.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.316+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:00:51.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.320+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:00:51.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.348+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:51.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.360+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:00:51.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 233 16 2542680 2542664 681.986 696.438 0.000817567 0.00145645 2024-09-16T15:00:51.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.384+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:00:51.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.400+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:00:51.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.420+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:00:51.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.428+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:00:51.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.432+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:00:51.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.436+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:00:51.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.456+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:00:51.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.464+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:00:51.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.500+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:00:51.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.516+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:00:51.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.516+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:00:51.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.528+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:00:51.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.532+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:00:51.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.532+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:00:51.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.576+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:00:51.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.592+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:00:51.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.608+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:00:51.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.632+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:00:51.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.660+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:00:51.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.668+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:00:51.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.680+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:00:51.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.684+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:00:51.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.688+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:00:51.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.692+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:00:51.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.716+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:00:51.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.724+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:00:51.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.736+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:00:51.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.784+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:00:51.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.800+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:00:51.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.808+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:00:51.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.824+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:00:51.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.828+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:00:51.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.876+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:00:51.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.880+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:00:51.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.888+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:00:51.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.928+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:00:51.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.932+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:00:51.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.948+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:00:51.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.952+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:00:51.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:51.996+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:00:52.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.000+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:00:52.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.012+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:00:52.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.016+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:00:52.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.036+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:52.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.040+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:00:52.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.048+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:52.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.096+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:00:52.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.096+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:00:52.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.116+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:52.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.128+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:00:52.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.132+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:00:52.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.140+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:00:52.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.172+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T15:00:52.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.196+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:52.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.200+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T15:00:52.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.204+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:00:52.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.204+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:00:52.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.220+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:00:52.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.240+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:00:52.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.264+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:00:52.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.272+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T15:00:52.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.336+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:00:52.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.336+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:00:52.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.344+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:00:52.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.348+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:00:52.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.352+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:00:52.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.368+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:00:52.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 234 16 2553017 2553001 681.833 646.062 0.000665789 0.00145676 2024-09-16T15:00:52.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.388+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:00:52.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.408+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:00:52.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.412+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:00:52.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.436+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:00:52.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.456+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:00:52.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.484+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T15:00:52.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.504+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T15:00:52.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.508+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:00:52.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.508+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:00:52.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.532+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:00:52.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.536+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T15:00:52.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.540+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:00:52.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.544+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:00:52.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.576+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:00:52.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.580+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:52.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.608+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:00:52.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.612+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:00:52.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.616+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:00:52.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.656+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:00:52.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.656+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:52.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.668+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:00:52.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.672+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:00:52.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.700+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:00:52.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.700+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:00:52.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.708+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T15:00:52.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.736+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:00:52.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.752+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:00:52.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.756+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:00:52.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.772+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T15:00:52.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.784+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:00:52.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.792+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T15:00:52.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.820+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:00:52.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.832+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:52.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.832+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:00:52.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.864+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:00:52.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.888+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:00:52.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.900+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:00:52.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.900+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:00:52.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.904+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T15:00:52.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.916+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:00:52.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.924+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:00:52.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.944+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:00:52.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:52.992+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:00:53.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.020+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:00:53.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.024+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:00:53.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.024+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T15:00:53.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.052+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:00:53.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.056+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:00:53.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.064+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:00:53.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.104+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:00:53.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.108+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:00:53.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.124+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:00:53.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.148+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:00:53.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.152+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:00:53.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.168+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:00:53.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.184+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:00:53.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.184+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:00:53.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.192+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:00:53.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.228+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T15:00:53.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.240+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:00:53.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.240+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:00:53.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.264+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:00:53.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.276+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:00:53.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.296+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:00:53.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.320+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:00:53.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.324+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:00:53.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.336+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:00:53.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.344+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T15:00:53.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.360+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:00:53.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 235 16 2563120 2563104 681.618 631.438 0.00134596 0.00145724 2024-09-16T15:00:53.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.388+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:00:53.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.392+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:00:53.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.392+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T15:00:53.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.416+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T15:00:53.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.436+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:00:53.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.448+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:00:53.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.472+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:00:53.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.476+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:00:53.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.484+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:00:53.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.532+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:00:53.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.540+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:00:53.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.568+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:00:53.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.592+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:00:53.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.600+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:00:53.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.604+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:00:53.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.612+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T15:00:53.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.624+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:00:53.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.640+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:00:53.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.688+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:00:53.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.716+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:00:53.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.716+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:00:53.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.720+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:53.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.752+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T15:00:53.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.756+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:00:53.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.756+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T15:00:53.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.816+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:00:53.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.824+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:00:53.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.844+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:00:53.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.860+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:00:53.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.892+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:00:53.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.908+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:00:53.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.928+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:53.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.928+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:53.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.952+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T15:00:53.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.960+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:00:53.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.964+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:00:53.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.984+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T15:00:53.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:53.992+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T15:00:54.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.000+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:00:54.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.020+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:00:54.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.040+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:00:54.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.044+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:00:54.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.052+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:00:54.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.068+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:00:54.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.076+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:00:54.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.108+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:00:54.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.112+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:00:54.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.112+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:00:54.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.128+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:00:54.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.152+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:00:54.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.156+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:00:54.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.160+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:00:54.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.220+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:00:54.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.232+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:00:54.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.252+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:00:54.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.252+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:00:54.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.256+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:54.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.264+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:00:54.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.284+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:00:54.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.288+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:00:54.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.296+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:00:54.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.304+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:00:54.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.324+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:00:54.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.344+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:00:54.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.356+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:00:54.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 236 16 2574120 2574104 681.643 687.5 0.00101649 0.0014572 2024-09-16T15:00:54.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.380+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:00:54.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.384+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:00:54.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.408+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:00:54.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.412+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:00:54.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.428+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:54.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.432+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:00:54.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.472+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:54.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.480+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:00:54.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.480+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:00:54.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.496+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:00:54.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.496+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:00:54.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.504+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:00:54.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.540+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:00:54.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.576+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:00:54.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.584+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:00:54.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.612+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:54.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.616+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:00:54.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.628+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:00:54.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.636+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:00:54.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.656+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:00:54.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.664+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:00:54.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.664+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:00:54.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.672+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:00:54.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.684+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:00:54.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.684+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:00:54.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.724+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:00:54.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.732+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T15:00:54.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.760+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:00:54.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.764+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:00:54.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.772+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:00:54.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.776+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:00:54.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.792+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:00:54.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.808+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:00:54.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.844+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:00:54.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.868+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:00:54.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.872+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:00:54.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.876+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:00:54.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.880+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:00:54.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.884+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:00:54.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.916+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:00:54.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.972+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:00:54.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:54.988+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T15:00:55.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.000+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:00:55.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.016+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:00:55.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.024+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:00:55.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.044+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:00:55.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.048+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:00:55.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.056+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:00:55.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.056+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:00:55.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.080+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:00:55.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.096+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:00:55.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.112+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:00:55.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.120+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:00:55.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.148+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:00:55.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.168+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:00:55.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.176+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:00:55.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.184+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:00:55.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.216+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:00:55.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.224+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:00:55.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.228+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:00:55.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.236+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:00:55.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.236+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:00:55.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.248+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:00:55.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.276+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T15:00:55.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.300+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:00:55.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.300+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:00:55.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.300+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:00:55.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.332+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:00:55.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.332+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T15:00:55.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.364+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:00:55.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.372+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:00:55.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 237 16 2585122 2585106 681.668 687.625 0.000670337 0.00145715 2024-09-16T15:00:55.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.380+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:00:55.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.392+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:00:55.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.408+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:55.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.408+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:00:55.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.412+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:00:55.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.436+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:00:55.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.460+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:00:55.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.504+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:00:55.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.508+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:00:55.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.508+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:00:55.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.536+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T15:00:55.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.536+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:00:55.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.560+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:00:55.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.596+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:00:55.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.616+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:55.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.632+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:00:55.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.636+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T15:00:55.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.640+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:00:55.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.644+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:00:55.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.668+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:00:55.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.672+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:00:55.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.704+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:00:55.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.716+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:00:55.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.732+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:00:55.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.744+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:00:55.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.760+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:00:55.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.784+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:00:55.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.788+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:55.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.808+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:00:55.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.812+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:00:55.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.816+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:00:55.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.844+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:00:55.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.848+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:00:55.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.860+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:00:55.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.864+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:00:55.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.876+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:00:55.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.900+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:00:55.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.904+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T15:00:55.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.944+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:55.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.956+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:00:55.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.960+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:00:55.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:55.996+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:56.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.024+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:00:56.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.032+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T15:00:56.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.040+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:00:56.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.048+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:00:56.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.064+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:00:56.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.100+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:00:56.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.104+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:00:56.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.104+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:00:56.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.144+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:00:56.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.176+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:00:56.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.184+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:00:56.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.192+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:00:56.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.212+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:00:56.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.212+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:00:56.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.216+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:00:56.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.248+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T15:00:56.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.256+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:00:56.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.272+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T15:00:56.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.284+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:00:56.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.288+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:00:56.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.292+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:00:56.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.344+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:00:56.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.356+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:00:56.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.368+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:00:56.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 238 16 2596269 2596253 681.73 696.688 0.000687686 0.00145701 2024-09-16T15:00:56.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.376+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:00:56.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.380+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:00:56.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.400+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T15:00:56.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.404+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:00:56.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.412+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T15:00:56.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.452+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T15:00:56.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.472+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:00:56.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.484+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T15:00:56.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.496+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:00:56.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.508+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:00:56.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.536+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:00:56.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.556+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T15:00:56.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.556+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:00:56.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.596+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:00:56.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.600+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:00:56.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.620+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:00:56.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.620+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:00:56.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.636+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:00:56.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.636+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:00:56.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.660+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:00:56.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.660+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:00:56.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.680+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:00:56.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.688+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:00:56.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.712+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:00:56.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.720+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:00:56.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.740+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T15:00:56.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.760+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:00:56.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.760+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:00:56.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.776+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:00:56.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.788+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T15:00:56.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.796+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:00:56.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.804+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:00:56.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.836+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:00:56.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.848+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:00:56.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.852+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:00:56.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.856+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:00:56.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.892+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T15:00:56.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.916+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:56.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.924+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:00:56.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:56.936+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T15:00:57.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.016+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:57.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.024+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:00:57.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.044+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:00:57.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.044+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:00:57.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.048+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:00:57.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.068+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:00:57.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.080+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:00:57.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.092+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:00:57.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.100+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:00:57.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.132+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:00:57.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.136+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:00:57.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.140+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:00:57.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.144+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:00:57.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.156+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:00:57.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.172+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:00:57.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.208+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T15:00:57.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.240+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:00:57.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.252+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:00:57.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 239 16 2606309 2606293 681.503 627.5 0.00169267 0.00145742 2024-09-16T15:00:57.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.372+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:00:57.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.420+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:00:57.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.420+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:00:57.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.448+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T15:00:57.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.456+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T15:00:57.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.504+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:00:57.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.512+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T15:00:57.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.528+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:00:57.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.540+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:00:57.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.544+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:00:57.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.556+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:00:57.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.592+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:00:57.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.600+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:00:57.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.600+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:00:57.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.632+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:00:57.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.648+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:00:57.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.668+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:00:57.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.696+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:00:57.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.696+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:00:57.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.708+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T15:00:57.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.724+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:00:57.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.740+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:00:57.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.756+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:00:57.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.768+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:00:57.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.772+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:00:57.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.792+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:00:57.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.812+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T15:00:57.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.816+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:00:57.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.824+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:00:57.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.836+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:00:57.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.856+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:00:57.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.856+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:00:57.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.864+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:00:57.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.880+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:00:57.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.904+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:00:57.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.920+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:00:57.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.920+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:00:57.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.932+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:00:57.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.960+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:00:57.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:57.968+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:00:58.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.008+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:00:58.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.012+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:00:58.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.028+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:00:58.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.064+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:00:58.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:00:58.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.076+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:00:58.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.080+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:00:58.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.100+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:00:58.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.108+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:00:58.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.108+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:00:58.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.112+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:00:58.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.148+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:00:58.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.160+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:00:58.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.168+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:00:58.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.172+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:00:58.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.200+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:00:58.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.208+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:00:58.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.224+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:00:58.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.228+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:00:58.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.232+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:00:58.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.244+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T15:00:58.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:00:58.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.264+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:00:58.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.268+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:00:58.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.312+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:00:58.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.320+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:00:58.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.340+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:00:58.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.360+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:00:58.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.360+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T15:00:58.375 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:00:58.376196+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.00145771 2024-09-16T15:00:58.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:00:58.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 240 16 2616843 2616827 681.407 658.375 0.00101951 0.00145771 2024-09-16T15:00:58.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.372+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:00:58.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.376+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:00:58.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.380+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:00:58.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.408+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:00:58.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.428+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:00:58.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.448+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:00:58.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.452+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:00:58.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.460+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:00:58.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.488+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:00:58.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.492+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:00:58.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.536+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:00:58.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.560+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:00:58.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.564+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:00:58.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.572+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T15:00:58.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.580+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:00:58.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.592+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T15:00:58.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.624+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:00:58.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.640+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:00:58.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.656+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T15:00:58.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.684+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:00:58.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.684+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:00:58.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.716+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T15:00:58.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.732+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:00:58.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.768+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:00:58.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.784+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:00:58.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.800+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:00:58.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.804+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:00:58.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.808+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:00:58.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.812+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:00:58.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.820+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:00:58.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.820+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:00:58.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.848+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:00:58.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.864+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:00:58.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.864+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:00:58.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.884+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:00:58.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.896+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:00:58.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.940+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:00:58.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.944+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:00:58.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.960+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:00:58.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.960+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:00:58.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:58.968+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:00:59.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.004+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:00:59.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.004+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:00:59.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.020+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:00:59.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.052+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:00:59.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.052+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T15:00:59.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.060+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:00:59.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.064+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:59.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.072+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:00:59.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.120+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:00:59.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.128+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:00:59.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.152+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:00:59.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.156+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:00:59.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.180+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:00:59.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.180+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:00:59.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.184+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:00:59.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.192+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:00:59.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.204+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:00:59.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.220+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T15:00:59.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.268+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf1d9a19:::benchmark_data_smithi116_28801_object3210:head, will try copies on 2,3 2024-09-16T15:00:59.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.276+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:00:59.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.288+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:00:59.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.308+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:00:59.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.312+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:00:59.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.316+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:00:59.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.316+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:00:59.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.344+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:00:59.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.360+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T15:00:59.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 241 15 2628090 2628075 681.496 703 0.00151309 0.00145751 2024-09-16T15:00:59.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.380+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T15:00:59.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.392+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:00:59.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.416+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:00:59.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.416+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:00:59.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.432+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:00:59.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.452+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:00:59.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.460+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:00:59.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.468+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:00:59.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.480+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:00:59.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.480+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:00:59.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.492+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:00:59.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.504+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:00:59.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.508+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:00:59.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.524+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:00:59.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.552+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:00:59.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.552+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:00:59.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.584+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:00:59.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.584+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:00:59.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.632+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:00:59.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.640+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:00:59.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.648+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:00:59.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.668+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:00:59.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.684+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:00:59.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.692+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:00:59.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.708+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T15:00:59.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.708+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:00:59.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.712+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:00:59.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.724+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:00:59.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.744+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T15:00:59.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.772+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:00:59.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.772+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:00:59.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.820+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:00:59.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.828+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:00:59.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.836+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:00:59.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.836+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:00:59.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.844+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:00:59.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.860+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:00:59.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.892+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T15:00:59.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.912+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:00:59.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.932+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:00:59.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.932+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:00:59.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.948+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:00:59.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.956+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:00:59.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:00:59.968+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:01:00.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.004+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:01:00.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.024+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:01:00.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.040+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:01:00.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.040+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:01:00.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.064+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:01:00.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.076+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T15:01:00.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.088+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:01:00.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.096+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:01:00.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.100+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:00.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.108+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:00.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.108+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T15:01:00.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.140+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:01:00.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.176+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:01:00.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.176+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:01:00.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.184+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:01:00.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.196+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:01:00.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.220+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:01:00.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.220+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:00.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.224+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T15:01:00.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.308+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:01:00.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.312+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:01:00.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.328+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:01:00.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.336+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T15:01:00.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.344+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:01:00.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.352+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:01:00.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.356+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:01:00.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.360+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:01:00.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 242 16 2639106 2639090 681.524 688.438 0.000576452 0.00145744 2024-09-16T15:01:00.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.424+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:01:00.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.444+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:01:00.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.456+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:01:00.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.476+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:00.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.480+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:01:00.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.492+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:01:00.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.504+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:01:00.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.516+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:00.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.524+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:01:00.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.536+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:01:00.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.540+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:01:00.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.560+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:01:00.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.564+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:01:00.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.580+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:01:00.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.596+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:01:00.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.608+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:01:00.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.628+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:01:00.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.636+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:01:00.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.644+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T15:01:00.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.648+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:01:00.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.652+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:01:00.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.652+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:01:00.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.672+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T15:01:00.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.700+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:01:00.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.708+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:01:00.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.720+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:01:00.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.736+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:01:00.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.776+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:01:00.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.796+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:00.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.800+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:01:00.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.820+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:01:00.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.840+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:01:00.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.848+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:00.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.860+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:01:00.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.864+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:01:00.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.888+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:01:00.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.896+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T15:01:00.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.928+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:01:00.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.940+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:00.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.956+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:01:00.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.984+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:01:00.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.988+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:01:00.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:00.988+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:01:01.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.008+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:01:01.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.036+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:01:01.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.044+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:01:01.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.044+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:01:01.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.056+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:01.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.072+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:01:01.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.084+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:01:01.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.088+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:01:01.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.128+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:01:01.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.140+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:01:01.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.160+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:01:01.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.180+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:01:01.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.192+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:01:01.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.204+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:01:01.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.204+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:01:01.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.244+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:01:01.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.256+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:01.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.280+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:01:01.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.296+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:01:01.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.308+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T15:01:01.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.324+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:01:01.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.328+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:01:01.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.340+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:01:01.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.372+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:01:01.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 243 16 2650200 2650184 681.573 693.375 0.000849121 0.00145736 2024-09-16T15:01:01.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.380+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:01.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.380+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:01:01.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.400+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:01.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.420+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:01:01.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.424+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:01:01.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.436+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:01:01.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.448+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T15:01:01.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.456+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:01:01.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.508+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:01.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.512+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:01:01.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.520+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:01:01.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.528+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:01:01.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.532+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:01:01.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.544+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:01:01.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.552+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:01:01.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.604+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:01:01.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.624+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:01:01.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.628+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:01:01.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.636+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:01:01.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.664+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:01:01.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.672+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:01:01.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.692+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:01:01.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.704+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:01:01.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.712+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:01:01.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.744+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T15:01:01.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.776+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:01:01.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.808+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:01:01.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.828+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:01:01.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.840+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:01:01.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.852+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:01:01.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.868+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:01:01.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.872+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:01:01.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.884+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:01.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.904+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:01:01.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.916+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:01:01.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.944+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:01:01.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.948+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:01:01.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.952+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:01:01.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.964+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:01:01.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:01.980+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:01:02.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.000+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:01:02.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.012+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:01:02.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.028+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:01:02.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.032+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:01:02.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.052+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:02.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.068+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:01:02.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.080+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:01:02.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.088+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:01:02.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.100+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:01:02.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.108+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:01:02.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.128+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:01:02.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.132+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:02.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.132+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:01:02.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.140+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:01:02.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.180+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:01:02.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.188+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:01:02.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.216+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:01:02.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.232+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:01:02.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.256+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:01:02.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.272+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:01:02.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.300+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:01:02.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.304+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:01:02.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.312+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:01:02.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.324+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:01:02.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.340+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:01:02.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.356+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:01:02.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.364+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:01:02.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 244 16 2661426 2661410 681.655 701.625 0.000772688 0.00145717 2024-09-16T15:01:02.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.380+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:01:02.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.388+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:01:02.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.392+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:01:02.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.408+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:01:02.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.428+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:02.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.464+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:01:02.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.468+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T15:01:02.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.480+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:01:02.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.484+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:01:02.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.508+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:01:02.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.508+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:01:02.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.524+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:01:02.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.564+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T15:01:02.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.568+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:01:02.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.572+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:01:02.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.576+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:01:02.593 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.588+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:01:02.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.604+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:02.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.604+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:01:02.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.608+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T15:01:02.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.636+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:01:02.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.640+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T15:01:02.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.644+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T15:01:02.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.652+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:01:02.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.668+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:01:02.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.676+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:01:02.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.692+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:01:02.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.708+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:01:02.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.720+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:01:02.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.736+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:01:02.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.744+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T15:01:02.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.760+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:01:02.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.796+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:02.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.820+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:01:02.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.824+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:02.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.840+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:01:02.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.840+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T15:01:02.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.868+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:01:02.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.904+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:01:02.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.908+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T15:01:02.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.932+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:01:02.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.936+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:01:02.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.940+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:01:02.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.952+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:02.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.984+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:01:02.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.984+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T15:01:02.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:02.992+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:01:03.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.000+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:01:03.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.000+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:01:03.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.020+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:01:03.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.040+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:01:03.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.076+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:01:03.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.084+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:01:03.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.096+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:03.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.120+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:01:03.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.140+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T15:01:03.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.164+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:03.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.164+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:01:03.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.168+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:01:03.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.204+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:01:03.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.208+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:01:03.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.236+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:01:03.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.240+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:01:03.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.252+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:01:03.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.264+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:01:03.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.296+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:01:03.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.296+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:01:03.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.312+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T15:01:03.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.316+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:01:03.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.320+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:03.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.320+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:01:03.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.336+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:01:03.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 245 16 2672206 2672190 681.622 673.75 0.000913548 0.00145722 2024-09-16T15:01:03.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.384+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:01:03.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.388+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:01:03.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.400+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:03.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.440+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:01:03.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.444+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:03.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.456+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:01:03.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.464+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:01:03.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.476+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:01:03.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.476+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:01:03.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.480+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:01:03.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.500+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:01:03.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.508+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:01:03.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.516+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:01:03.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.528+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:01:03.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.544+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:01:03.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.560+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:01:03.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.588+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:01:03.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.592+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:01:03.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.600+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T15:01:03.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.608+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:01:03.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.616+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:01:03.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.620+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:01:03.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.628+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:01:03.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.640+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:03.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.676+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T15:01:03.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.676+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T15:01:03.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.684+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:03.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.696+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:01:03.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.720+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:03.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.720+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:03.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.748+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:01:03.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.776+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:01:03.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.824+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:03.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.824+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:01:03.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.828+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:01:03.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.872+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:01:03.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.872+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:01:03.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.892+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:01:03.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.892+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T15:01:03.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.916+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:01:03.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.924+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:03.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.932+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:01:03.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.932+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:03.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.932+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:01:03.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.944+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:01:03.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.964+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:01:03.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:03.988+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:01:04.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.000+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:01:04.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.024+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:01:04.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.040+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:04.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.044+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T15:01:04.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.048+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:01:04.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.052+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:01:04.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.080+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:04.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.080+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:01:04.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.104+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:01:04.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.116+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T15:01:04.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.128+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:01:04.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.132+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:01:04.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.136+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:01:04.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.188+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:01:04.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.188+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:01:04.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.212+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:01:04.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.216+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:01:04.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.216+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:01:04.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.228+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:01:04.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.252+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:01:04.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.264+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:01:04.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.288+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:01:04.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.296+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:01:04.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.300+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:01:04.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.320+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:04.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.328+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:01:04.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.356+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:04.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 246 16 2683140 2683124 681.629 683.375 0.000922719 0.00145723 2024-09-16T15:01:04.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.376+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:01:04.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.392+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T15:01:04.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.428+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:01:04.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.440+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T15:01:04.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.456+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:01:04.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.464+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:04.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.472+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:01:04.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.472+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:01:04.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.480+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:01:04.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.504+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:01:04.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.508+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:01:04.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.532+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:01:04.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.532+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:01:04.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.540+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T15:01:04.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.548+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:01:04.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.588+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:01:04.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.624+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T15:01:04.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.640+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:01:04.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.676+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:01:04.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.680+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T15:01:04.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.696+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:01:04.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.712+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:01:04.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.732+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:01:04.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.760+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:01:04.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.760+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:01:04.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.764+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:01:04.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.796+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:01:04.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.804+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:01:04.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.820+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:01:04.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.836+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:01:04.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.852+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:01:04.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.860+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:01:04.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.864+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:01:04.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.880+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:04.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.892+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:01:04.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.904+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:01:04.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.908+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:01:04.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.912+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:04.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.916+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:01:04.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.948+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:01:04.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.952+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:04.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.956+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:01:05.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:04.996+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:01:05.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.028+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:01:05.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.040+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:01:05.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.044+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:01:05.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.060+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T15:01:05.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.076+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:01:05.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.108+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:01:05.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.108+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:01:05.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.128+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:01:05.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.136+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:01:05.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.140+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T15:01:05.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.140+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:01:05.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.148+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:01:05.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.164+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:05.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.172+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:01:05.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.216+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:01:05.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.244+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:01:05.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.256+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T15:01:05.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.260+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:01:05.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.272+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:01:05.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.284+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:01:05.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.316+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:01:05.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.324+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:01:05.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.324+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:01:05.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.328+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:01:05.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.352+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:01:05.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.372+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:01:05.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 247 16 2694280 2694264 681.688 696.25 0.001714 0.0014571 2024-09-16T15:01:05.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.376+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T15:01:05.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.380+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:01:05.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.408+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:01:05.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.440+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:01:05.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.452+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:01:05.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.476+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:01:05.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.476+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:01:05.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.512+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:01:05.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.544+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:01:05.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.548+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:01:05.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.564+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:01:05.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.576+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:01:05.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.588+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:01:05.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.600+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:01:05.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.608+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:01:05.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.640+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:01:05.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.640+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:01:05.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.648+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:01:05.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.684+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:01:05.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.684+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:05.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.684+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:01:05.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.736+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:01:05.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.740+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:01:05.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.756+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:01:05.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.760+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:01:05.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.764+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:01:05.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.804+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:01:05.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.812+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:05.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.844+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:05.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.848+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:01:05.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.876+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:01:05.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.888+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:01:05.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.892+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T15:01:05.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.920+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:01:05.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.920+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:01:05.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.936+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T15:01:05.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.976+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:01:05.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.996+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:01:05.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.996+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T15:01:05.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:05.996+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:01:06.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.008+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:01:06.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.024+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T15:01:06.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.036+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:01:06.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.036+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T15:01:06.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.044+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:01:06.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.076+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T15:01:06.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.076+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:01:06.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.088+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:01:06.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.096+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:06.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.124+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:01:06.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.124+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:01:06.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.156+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:01:06.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.172+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:01:06.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.176+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:01:06.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.188+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:01:06.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.196+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:01:06.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.216+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:06.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.220+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:01:06.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.228+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T15:01:06.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:01:06.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.276+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:06.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.304+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:06.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.324+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:01:06.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.332+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:01:06.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.336+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T15:01:06.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.356+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:01:06.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 248 16 2705448 2705432 681.754 698 0.00217582 0.00145697 2024-09-16T15:01:06.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.380+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:01:06.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.424+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:01:06.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.432+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:01:06.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.444+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:01:06.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.460+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:01:06.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.508+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:01:06.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.528+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T15:01:06.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.556+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:01:06.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.556+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:01:06.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.572+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:06.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.608+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T15:01:06.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.612+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:01:06.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.636+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:01:06.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.640+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:01:06.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.660+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:01:06.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.672+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:01:06.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.700+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:01:06.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.716+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:01:06.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.752+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:01:06.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.760+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:01:06.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.764+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:01:06.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.776+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:01:06.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.808+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T15:01:06.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.828+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:01:06.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.828+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:01:06.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.832+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:01:06.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.840+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:01:06.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.880+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T15:01:06.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.884+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:01:06.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.892+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:01:06.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.924+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:01:06.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.952+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:01:06.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.956+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:01:06.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.972+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:01:06.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.992+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:06.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:06.996+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:01:07.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.004+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T15:01:07.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.008+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:01:07.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.044+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:01:07.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.060+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:01:07.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.064+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:01:07.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.068+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:01:07.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.080+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:01:07.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.088+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T15:01:07.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.120+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:01:07.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.136+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:07.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.148+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:01:07.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.152+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:01:07.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.164+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:01:07.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.192+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:01:07.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.192+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:01:07.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.224+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:01:07.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.232+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:01:07.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.232+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:01:07.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.264+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:01:07.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:01:07.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.272+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:01:07.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.280+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:01:07.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.292+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:01:07.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.324+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:07.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.332+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:01:07.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.344+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:01:07.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.348+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:01:07.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.352+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:01:07.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.364+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:01:07.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.368+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T15:01:07.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 249 16 2716921 2716905 681.895 717.062 0.000595858 0.00145664 2024-09-16T15:01:07.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.400+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:01:07.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.408+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:01:07.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.416+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:01:07.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.440+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:07.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.444+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:01:07.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.452+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:07.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.456+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:01:07.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.468+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:01:07.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.480+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:01:07.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.516+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:01:07.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.516+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:01:07.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.544+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:01:07.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.548+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T15:01:07.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.556+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:01:07.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.584+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:01:07.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.584+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:01:07.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.612+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:01:07.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.616+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:01:07.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.644+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:01:07.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.644+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T15:01:07.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.648+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:01:07.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.656+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:01:07.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.664+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:01:07.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.704+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:01:07.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.708+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:01:07.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.716+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:01:07.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.720+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:01:07.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.732+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:01:07.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.788+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:01:07.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.792+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T15:01:07.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.796+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:01:07.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.808+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:07.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.832+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:01:07.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.856+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T15:01:07.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.860+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:01:07.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.860+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:01:07.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.888+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:01:07.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.904+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:01:07.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.916+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T15:01:07.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.940+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:01:07.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.956+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:01:07.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.984+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:07.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:07.992+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:01:08.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.012+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:01:08.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.020+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:01:08.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.020+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:01:08.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.028+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T15:01:08.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.032+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:01:08.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.040+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:01:08.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.044+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:01:08.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.068+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T15:01:08.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:08.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.092+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:01:08.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.100+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T15:01:08.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.108+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:01:08.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.128+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:01:08.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.144+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:01:08.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.148+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:01:08.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.156+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:08.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.160+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:01:08.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.204+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T15:01:08.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.212+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:01:08.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.248+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:08.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.288+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:01:08.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.300+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:01:08.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.304+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:01:08.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.308+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:08.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.332+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:01:08.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.356+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T15:01:08.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.368+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:01:08.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 250 16 2728135 2728119 681.971 700.875 0.000965619 0.0014565 2024-09-16T15:01:08.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.376+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T15:01:08.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.408+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:01:08.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.424+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:08.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.424+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:08.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.464+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:01:08.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.476+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T15:01:08.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.480+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:01:08.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.488+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:01:08.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.512+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:01:08.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.520+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:01:08.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.564+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T15:01:08.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.568+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T15:01:08.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.568+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:01:08.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.576+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T15:01:08.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.608+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:01:08.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.624+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:01:08.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.656+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:01:08.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.672+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:01:08.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.676+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:01:08.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.692+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:01:08.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.716+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:01:08.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.744+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:01:08.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.744+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:01:08.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.748+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:01:08.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.760+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:01:08.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.784+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:01:08.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.800+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:01:08.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:01:08.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.836+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:01:08.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.836+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:01:08.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.872+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T15:01:08.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.884+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:01:08.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.888+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:01:08.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.912+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:01:08.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.912+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:01:08.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.952+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:01:08.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.964+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:01:08.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.968+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:01:08.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.984+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:08.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:08.992+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:01:09.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.004+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T15:01:09.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.004+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:01:09.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.048+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:01:09.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.048+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:01:09.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.056+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:01:09.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.056+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:01:09.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.096+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:01:09.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.104+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:01:09.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.124+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:01:09.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.124+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:01:09.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.128+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:01:09.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.148+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T15:01:09.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.152+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:01:09.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.164+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T15:01:09.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.212+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:01:09.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.216+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:01:09.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.248+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:09.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.252+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:01:09.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.292+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:01:09.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.332+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:01:09.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.344+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T15:01:09.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.372+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:01:09.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 251 16 2739649 2739633 682.121 719.625 0.00203796 0.00145617 2024-09-16T15:01:09.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.384+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:01:09.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.392+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:01:09.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.404+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:01:09.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.416+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:01:09.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.444+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:01:09.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.468+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T15:01:09.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.472+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:01:09.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.480+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:01:09.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.492+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:01:09.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.500+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:01:09.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.548+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:01:09.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.552+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T15:01:09.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.568+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:01:09.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.576+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:01:09.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.580+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:01:09.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.592+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:01:09.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.608+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:01:09.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.640+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:01:09.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.644+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:09.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.644+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:01:09.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.656+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:01:09.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.660+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:01:09.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.676+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:09.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.680+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:01:09.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.724+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:01:09.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.756+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:01:09.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.760+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:01:09.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.772+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:01:09.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.780+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:01:09.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.808+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:01:09.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.820+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:09.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.832+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:01:09.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.844+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:09.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.848+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:01:09.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.856+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T15:01:09.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.868+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:09.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.872+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:01:09.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.880+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:01:09.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.888+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:01:09.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.904+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:01:09.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.972+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:01:09.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.972+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:01:09.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.980+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:01:09.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:09.980+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:01:10.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.016+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b045e4:::benchmark_data_smithi116_28801_object935:head, will try copies on 0,4 2024-09-16T15:01:10.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.020+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:01:10.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.024+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:01:10.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.036+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:01:10.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.060+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:01:10.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.072+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:01:10.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.092+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:01:10.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.104+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:10.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.128+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T15:01:10.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.144+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T15:01:10.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.148+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:01:10.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.164+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:01:10.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.172+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:01:10.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.184+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:01:10.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.192+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:01:10.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.220+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:01:10.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.236+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:01:10.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.244+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:01:10.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.276+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:01:10.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.300+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:01:10.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.312+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:01:10.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.324+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:01:10.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.332+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:01:10.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.340+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:01:10.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.348+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:01:10.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.368+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:01:10.376 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 252 16 2750791 2750775 682.177 696.375 0.000706435 0.00145604 2024-09-16T15:01:10.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.400+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:01:10.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.404+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:01:10.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.444+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:01:10.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.456+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:01:10.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.484+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:01:10.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.492+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:01:10.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.496+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:01:10.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.528+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:01:10.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.532+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:01:10.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.536+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:01:10.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.536+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:01:10.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.560+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:01:10.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.572+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:01:10.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.572+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:01:10.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.588+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:01:10.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.592+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:01:10.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.596+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:01:10.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.636+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:01:10.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.640+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:01:10.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.648+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:01:10.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.680+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:01:10.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.700+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:01:10.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.704+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:01:10.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.708+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:01:10.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.728+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:01:10.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.756+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:01:10.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.776+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:01:10.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.788+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:01:10.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.812+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:01:10.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.836+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:01:10.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.836+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:01:10.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.852+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:01:10.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.852+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:01:10.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.856+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:01:10.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.888+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:10.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.892+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:01:10.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.908+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:01:10.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.920+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:01:10.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.932+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T15:01:10.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.964+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:01:10.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.968+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:01:10.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.972+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:01:10.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.988+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:01:10.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.992+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:01:10.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:10.996+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:01:11.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.016+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:11.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.024+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:01:11.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.032+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:01:11.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.060+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:01:11.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.060+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:01:11.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.064+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:01:11.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.072+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:01:11.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.092+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:01:11.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.104+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:01:11.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.132+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:01:11.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.144+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:01:11.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.160+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:01:11.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.164+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T15:01:11.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.176+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:01:11.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.176+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:01:11.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.180+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:01:11.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.212+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:01:11.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.220+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:01:11.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.244+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:01:11.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.300+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:01:11.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.300+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:01:11.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.320+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:01:11.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.332+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:01:11.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.332+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:01:11.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.344+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:01:11.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.360+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:01:11.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.368+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:01:11.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 253 15 2761783 2761768 682.196 687.062 0.000845515 0.001456 2024-09-16T15:01:11.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.384+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:01:11.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.400+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T15:01:11.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.412+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:01:11.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.428+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:01:11.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.432+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:01:11.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.432+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:11.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.452+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T15:01:11.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.476+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:01:11.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.488+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:01:11.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.512+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:01:11.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.516+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:11.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.544+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:01:11.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.544+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:01:11.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.580+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:01:11.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.608+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:01:11.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.620+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:01:11.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.644+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:01:11.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.668+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:01:11.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.668+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:01:11.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.688+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:01:11.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.696+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:01:11.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.708+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:01:11.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.708+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:01:11.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.732+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:01:11.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.752+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T15:01:11.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.756+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:01:11.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.772+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:01:11.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.780+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:01:11.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.784+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T15:01:11.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.808+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:01:11.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.856+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:01:11.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.872+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:01:11.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.876+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:01:11.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.912+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:01:11.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.920+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T15:01:11.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.928+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:01:11.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.948+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:01:11.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:11.976+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:01:12.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.000+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:01:12.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.020+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:01:12.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.020+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:01:12.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.036+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:01:12.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.044+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:01:12.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.052+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:12.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.052+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T15:01:12.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.072+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:01:12.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.108+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:01:12.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.124+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:01:12.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.136+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:12.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.152+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:01:12.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.160+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:01:12.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.164+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:01:12.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.176+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:01:12.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.204+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:01:12.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.204+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T15:01:12.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.212+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:01:12.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.216+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T15:01:12.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.232+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:01:12.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.232+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:01:12.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.248+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:01:12.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.276+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:01:12.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.276+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T15:01:12.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.288+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:01:12.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.292+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:01:12.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.296+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:01:12.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.312+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:01:12.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.324+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:01:12.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.360+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:12.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.372+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T15:01:12.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.372+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:01:12.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 254 16 2772767 2772751 682.213 686.438 0.000611963 0.00145595 2024-09-16T15:01:12.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.380+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:12.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.416+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T15:01:12.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.436+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:01:12.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.440+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:01:12.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.460+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:01:12.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.472+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:01:12.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.496+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:01:12.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.508+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:01:12.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.508+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:01:12.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.532+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:01:12.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.548+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:01:12.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.556+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:01:12.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.576+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:01:12.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.604+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:01:12.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.612+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:01:12.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.640+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:01:12.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.652+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:01:12.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.668+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:01:12.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.672+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:01:12.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.696+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:01:12.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.696+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T15:01:12.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.716+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:01:12.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.752+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:01:12.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.772+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:01:12.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.772+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:01:12.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.808+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:12.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.816+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:01:12.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.820+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:01:12.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.856+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:01:12.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.872+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:01:12.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.884+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:01:12.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.892+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:01:12.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.896+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:01:12.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.908+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T15:01:12.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:12.936+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T15:01:13.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.000+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:01:13.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.008+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:01:13.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.016+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:01:13.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.028+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:13.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.032+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T15:01:13.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.044+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:01:13.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.068+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T15:01:13.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.088+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:01:13.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.100+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:01:13.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.108+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:01:13.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.120+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:01:13.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.120+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:01:13.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.136+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:13.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.164+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:01:13.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.168+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:01:13.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.176+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:01:13.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.200+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:01:13.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.212+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:01:13.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.216+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:01:13.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.228+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:01:13.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.232+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:01:13.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.244+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:13.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.268+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:01:13.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.280+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:01:13.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.284+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:01:13.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.308+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:01:13.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.316+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:13.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.332+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:01:13.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.372+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:01:13.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 255 15 2783962 2783947 682.281 699.75 0.00101452 0.00145583 2024-09-16T15:01:13.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.396+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:01:13.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.396+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:01:13.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.400+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:13.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.416+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:01:13.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.420+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:01:13.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.444+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:01:13.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.464+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:01:13.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.468+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:01:13.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.496+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:01:13.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.512+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T15:01:13.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.516+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:13.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.524+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:13.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.548+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:01:13.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.552+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:01:13.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.584+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:01:13.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.584+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:13.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.592+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T15:01:13.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.612+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:01:13.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.620+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:01:13.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.644+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:01:13.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.660+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:01:13.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.668+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:01:13.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.668+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T15:01:13.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.680+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:13.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.688+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:01:13.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.732+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:01:13.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.748+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:01:13.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.768+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:01:13.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.772+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:01:13.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.772+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:13.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.792+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:01:13.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.808+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:13.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.812+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:01:13.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.832+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:01:13.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.840+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:01:13.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.844+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:01:13.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.904+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:01:13.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.924+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:01:13.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.944+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:01:13.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.944+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T15:01:13.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.972+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:01:13.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.992+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T15:01:13.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:13.992+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:01:14.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.036+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T15:01:14.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.052+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:01:14.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.072+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:01:14.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.076+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:01:14.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.088+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:01:14.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.092+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:01:14.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.100+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:01:14.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.132+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:14.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.144+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T15:01:14.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.160+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:01:14.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.176+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:01:14.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.180+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:01:14.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.188+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T15:01:14.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.188+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:01:14.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.216+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:01:14.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.240+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:01:14.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.268+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:01:14.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.272+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T15:01:14.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.276+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:01:14.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.280+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:14.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.280+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:01:14.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.296+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:01:14.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.360+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:01:14.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.364+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:01:14.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.372+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:01:14.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 256 16 2794899 2794883 682.286 683.5 0.00430862 0.00145582 2024-09-16T15:01:14.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.380+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:01:14.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.404+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T15:01:14.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.408+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:01:14.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.428+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:01:14.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.468+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:01:14.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.480+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:01:14.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.500+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:01:14.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.500+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T15:01:14.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.504+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T15:01:14.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.512+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:01:14.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.524+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:01:14.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.568+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:01:14.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.572+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:01:14.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.592+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:01:14.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.612+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:01:14.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.632+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:01:14.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.632+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:01:14.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.652+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:01:14.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.672+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:01:14.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.672+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T15:01:14.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.680+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:01:14.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.724+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T15:01:14.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.728+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:01:14.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.732+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:01:14.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.768+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:01:14.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.784+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:01:14.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.784+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:01:14.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.820+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:01:14.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.844+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:01:14.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.856+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:14.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.868+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:01:14.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.872+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:01:14.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.876+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:01:14.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.880+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:01:14.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.896+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:01:14.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:14.996+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:15.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.004+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:01:15.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.012+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:01:15.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.028+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T15:01:15.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.040+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:01:15.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.056+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:01:15.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.068+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:01:15.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.076+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:15.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.120+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T15:01:15.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.132+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:01:15.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.136+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:01:15.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.152+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:01:15.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.176+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:01:15.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.180+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:01:15.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.192+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:01:15.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.200+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:01:15.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.236+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:01:15.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.256+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:01:15.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.272+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:01:15.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.292+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T15:01:15.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.296+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:01:15.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.340+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:01:15.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.348+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:15.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.356+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:01:15.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.360+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T15:01:15.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 257 16 2806439 2806423 682.437 721.25 0.000417682 0.00145549 2024-09-16T15:01:15.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.396+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:01:15.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.396+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:01:15.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.408+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:01:15.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.412+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T15:01:15.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.424+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:01:15.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.436+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:01:15.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.444+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:01:15.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.464+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:01:15.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.504+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:15.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.520+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:01:15.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.524+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:01:15.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.544+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:01:15.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.548+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:01:15.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.572+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:01:15.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.580+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:01:15.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.608+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:01:15.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.640+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:01:15.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.664+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:01:15.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.680+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:01:15.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.708+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T15:01:15.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.716+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:01:15.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.724+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:01:15.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.728+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:01:15.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.744+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:01:15.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.748+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:01:15.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.768+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:01:15.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.768+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:01:15.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.796+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T15:01:15.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.816+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:01:15.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.836+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:01:15.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.868+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:01:15.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.876+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T15:01:15.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.876+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:01:15.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.928+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:01:15.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.932+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:01:15.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.936+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:01:15.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.964+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:01:15.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:15.972+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:01:16.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.028+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:01:16.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.036+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:01:16.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.044+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T15:01:16.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.048+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:01:16.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.092+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:01:16.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.104+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:01:16.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.112+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T15:01:16.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.124+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:01:16.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.156+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:01:16.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.168+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:16.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.176+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:01:16.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.184+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T15:01:16.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.188+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T15:01:16.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.220+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:01:16.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.228+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:01:16.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.248+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:01:16.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.268+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:01:16.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.284+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:01:16.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.284+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:01:16.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.284+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:01:16.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.340+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T15:01:16.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.344+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:01:16.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.352+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:01:16.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.368+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:01:16.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 258 16 2817845 2817829 682.555 712.875 0.00139583 0.00145525 2024-09-16T15:01:16.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.388+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:01:16.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.396+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:01:16.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.400+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:01:16.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.436+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:01:16.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.444+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:16.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.456+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:01:16.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.464+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:16.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.472+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:01:16.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.516+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:01:16.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.524+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T15:01:16.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.528+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T15:01:16.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.528+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:01:16.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.548+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:01:16.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.564+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:01:16.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.576+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:01:16.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.576+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:01:16.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.592+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:01:16.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.604+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:01:16.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.620+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:01:16.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.624+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:01:16.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.628+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:01:16.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.644+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T15:01:16.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.656+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:16.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.680+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:01:16.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.684+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:01:16.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.708+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T15:01:16.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.728+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T15:01:16.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.732+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:01:16.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.744+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:01:16.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.756+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:01:16.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.796+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:16.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.800+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:01:16.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.800+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:01:16.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.804+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:01:16.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.820+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:01:16.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.836+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:01:16.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.872+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:01:16.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.880+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:01:16.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.900+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T15:01:16.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.920+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:01:16.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.924+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:01:16.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.943+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:01:16.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.943+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:01:16.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.955+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:01:16.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.971+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:01:17.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:16.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:01:17.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.015+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:01:17.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.051+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:01:17.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.063+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:01:17.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.071+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:17.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.071+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T15:01:17.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.103+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:01:17.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.119+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:01:17.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.135+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:01:17.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.135+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:01:17.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.139+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:01:17.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.139+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T15:01:17.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.159+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:01:17.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.175+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:01:17.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.199+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:17.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.211+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:01:17.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.231+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:17.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.239+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:01:17.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.255+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T15:01:17.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.287+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T15:01:17.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.291+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:17.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.295+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:01:17.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.343+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T15:01:17.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.367+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:01:17.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 259 15 2828761 2828746 682.554 682.312 0.000767384 0.00145525 2024-09-16T15:01:17.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.375+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:01:17.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.383+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:01:17.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.407+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:01:17.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.435+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:01:17.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.455+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:01:17.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:01:17.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.475+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:01:17.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.475+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:01:17.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.499+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:01:17.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.531+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:01:17.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.531+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:01:17.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.563+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:01:17.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.583+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:01:17.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.611+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:01:17.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:01:17.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.623+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:01:17.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.627+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:01:17.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.639+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:01:17.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.691+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:01:17.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.695+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:01:17.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.707+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:01:17.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.715+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:01:17.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.719+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:01:17.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.759+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:01:17.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.759+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:01:17.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.775+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:17.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.799+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:01:17.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.823+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:01:17.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.823+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:01:17.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.843+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:01:17.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.847+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:01:17.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.863+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:01:17.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.879+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:01:17.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.887+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:01:17.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.919+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:01:17.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.931+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:01:17.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.931+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:01:17.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.967+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:01:17.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.967+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T15:01:17.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.971+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:01:17.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:17.975+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:01:18.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.007+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:01:18.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.039+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:01:18.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T15:01:18.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.047+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:18.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.051+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:01:18.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.055+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:01:18.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.079+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:01:18.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.107+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T15:01:18.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.139+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:01:18.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.143+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:01:18.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.151+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:01:18.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.175+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:01:18.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.179+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T15:01:18.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:01:18.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.195+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:01:18.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.207+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:01:18.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.223+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:18.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.239+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:01:18.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.263+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:01:18.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.267+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:01:18.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.271+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:01:18.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.279+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:01:18.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.315+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:18.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:01:18.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.371+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:01:18.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:01:18.377875+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.00145519 2024-09-16T15:01:18.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:01:18.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 260 16 2839792 2839776 682.58 689.375 0.000851408 0.00145519 2024-09-16T15:01:18.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:01:18.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.411+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:01:18.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.443+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:01:18.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.443+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:01:18.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.443+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:01:18.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.479+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:18.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.479+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:01:18.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.491+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:01:18.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.495+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:01:18.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.507+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T15:01:18.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.551+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:01:18.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.555+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:01:18.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.559+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:01:18.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.587+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:01:18.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.599+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:01:18.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.619+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:01:18.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.647+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:01:18.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.647+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:01:18.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.647+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:01:18.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.687+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:01:18.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.707+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:18.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.711+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T15:01:18.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.711+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:01:18.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.739+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:01:18.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.747+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:18.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:18.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.775+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:01:18.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.795+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:01:18.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.807+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:01:18.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.815+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:01:18.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.855+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:01:18.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.863+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:01:18.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.879+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:01:18.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.887+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:18.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.895+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:01:18.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.895+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:01:18.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.907+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:01:18.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.923+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:18.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.947+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:01:18.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.955+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:01:18.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.955+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:01:18.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:18.971+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:01:19.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.003+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:19.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.039+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:01:19.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.039+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:01:19.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.063+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:01:19.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.063+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:01:19.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.067+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:01:19.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.107+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:01:19.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.107+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:01:19.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.119+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:01:19.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.131+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:01:19.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.151+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:01:19.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.163+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:01:19.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.183+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:01:19.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.191+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:19.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:01:19.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.215+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:01:19.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.215+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:01:19.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.219+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:01:19.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.219+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T15:01:19.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.251+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:01:19.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.283+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:01:19.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.295+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T15:01:19.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.315+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:01:19.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.339+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:01:19.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.347+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:19.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.355+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:19.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.355+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:01:19.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 261 16 2850876 2850860 682.619 692.75 0.000670046 0.00145509 2024-09-16T15:01:19.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.395+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:01:19.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.403+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:01:19.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.411+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:19.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.451+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:01:19.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.483+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:19.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.499+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:19.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.503+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:01:19.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.527+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:01:19.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.543+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:01:19.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.551+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:01:19.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.579+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:01:19.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.587+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:01:19.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.603+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:01:19.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.607+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:01:19.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.607+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:01:19.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.619+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:01:19.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.655+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:01:19.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.671+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:01:19.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.675+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:01:19.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.687+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:01:19.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.691+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:01:19.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.747+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:01:19.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.751+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:01:19.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.775+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:19.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.791+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:01:19.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.803+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:01:19.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.811+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:01:19.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.843+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:01:19.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T15:01:19.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.867+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:01:19.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.883+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:01:19.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.883+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:01:19.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.883+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:01:19.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.923+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:01:19.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.927+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:19.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.951+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:01:19.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.959+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:01:19.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.975+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:01:20.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:19.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:01:20.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.007+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:01:20.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.027+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:01:20.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.039+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:01:20.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.059+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:01:20.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.075+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:01:20.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.083+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:01:20.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.087+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:01:20.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.095+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:01:20.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.119+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T15:01:20.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.159+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:20.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.179+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:01:20.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.183+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:01:20.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.203+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:01:20.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.207+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:01:20.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.243+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:01:20.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.251+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:01:20.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.271+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:20.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.275+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:01:20.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.299+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:01:20.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.311+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:01:20.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.323+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:01:20.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.323+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:01:20.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.335+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:01:20.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.359+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:01:20.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.363+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:01:20.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 262 15 2862287 2862272 682.735 713.25 0.000980264 0.00145486 2024-09-16T15:01:20.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.379+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:01:20.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:01:20.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.403+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:01:20.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.407+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:01:20.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.463+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:01:20.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.463+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T15:01:20.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.467+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:20.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:01:20.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.495+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:01:20.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.511+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:01:20.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.535+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T15:01:20.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.555+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:20.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.559+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:01:20.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.563+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:01:20.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.571+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:01:20.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.603+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:01:20.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.603+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:01:20.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.607+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:01:20.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.623+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:01:20.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.623+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:01:20.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.643+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:20.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.667+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:01:20.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.687+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:01:20.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.691+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:01:20.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:01:20.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.739+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T15:01:20.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.739+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:01:20.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.747+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:01:20.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.747+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:01:20.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.759+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:01:20.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.767+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:01:20.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.795+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:01:20.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.807+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:01:20.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.835+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:01:20.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.847+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:01:20.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.855+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:01:20.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.863+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:01:20.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.871+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:01:20.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.879+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:01:20.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.911+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:01:20.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.919+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:01:20.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.919+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:01:20.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.939+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:01:20.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.967+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:01:20.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.975+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:01:20.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.987+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:01:21.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.995+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:01:21.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:20.999+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:01:21.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.015+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:21.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.031+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T15:01:21.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.031+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:21.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.051+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:21.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.083+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:01:21.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.103+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:01:21.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.123+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:01:21.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.139+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:01:21.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.171+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:01:21.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.187+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:01:21.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.199+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:01:21.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.215+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:21.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.223+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:01:21.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.239+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:01:21.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.251+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T15:01:21.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.259+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:01:21.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.267+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:01:21.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.271+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:01:21.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.279+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:01:21.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T15:01:21.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.319+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:01:21.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.347+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:01:21.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.355+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:01:21.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.359+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:01:21.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.363+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:01:21.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:01:21.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 263 16 2873366 2873350 682.772 692.375 0.000725067 0.00145478 2024-09-16T15:01:21.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.391+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:01:21.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:01:21.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.415+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:01:21.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:01:21.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.455+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:21.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.463+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T15:01:21.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.475+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:21.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:01:21.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.507+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:01:21.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.535+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:01:21.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.547+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:01:21.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.567+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:21.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.575+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:01:21.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.579+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:01:21.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.583+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:01:21.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.639+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:01:21.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:01:21.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.655+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:01:21.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.655+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:01:21.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.659+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:01:21.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.679+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:01:21.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.699+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:01:21.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.711+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:01:21.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.723+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:21.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.727+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:01:21.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.727+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:01:21.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.743+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:01:21.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.771+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:01:21.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.779+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:01:21.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.779+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:01:21.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.783+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:01:21.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.823+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:01:21.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.835+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:01:21.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.839+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:01:21.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.859+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:01:21.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.879+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:01:21.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.887+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:01:21.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.907+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:01:21.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.923+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:01:21.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.923+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T15:01:21.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.939+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T15:01:21.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.979+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:01:22.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.999+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:01:22.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:21.999+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:01:22.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.007+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:01:22.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.023+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:01:22.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.031+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:01:22.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.063+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:01:22.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.091+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:01:22.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.095+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:01:22.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.103+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:01:22.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.123+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:01:22.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.143+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:01:22.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.143+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:01:22.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.147+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:01:22.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.155+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:01:22.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.163+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:01:22.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.175+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:01:22.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.195+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:01:22.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.203+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:01:22.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.215+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T15:01:22.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.215+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:01:22.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.231+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:22.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.243+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:01:22.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.247+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T15:01:22.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.259+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:01:22.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.275+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:01:22.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.287+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:01:22.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.291+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T15:01:22.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.339+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:01:22.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.359+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:01:22.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.359+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:01:22.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 264 16 2884384 2884368 682.794 688.625 0.00158339 0.00145473 2024-09-16T15:01:22.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.375+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:01:22.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.387+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:01:22.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.399+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:01:22.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.427+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:22.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.431+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:01:22.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.443+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:01:22.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.447+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:01:22.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:01:22.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.487+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:01:22.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.495+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:01:22.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:01:22.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:01:22.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.551+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:01:22.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.551+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:01:22.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:01:22.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.571+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:01:22.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.591+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:01:22.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.591+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:01:22.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.631+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:01:22.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.639+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:01:22.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.655+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:01:22.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.687+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:01:22.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.699+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:01:22.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.699+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:01:22.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.719+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:01:22.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.731+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:01:22.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.739+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:01:22.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.739+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:22.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.743+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:01:22.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:01:22.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.803+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:01:22.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.819+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:01:22.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.827+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:01:22.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.831+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:01:22.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.835+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:01:22.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.843+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:01:22.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.879+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:01:22.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.887+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:01:22.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.899+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:22.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.911+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:01:22.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.939+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:01:22.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.947+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:01:22.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.947+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:01:22.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.951+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:01:22.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:22.987+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:01:23.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.007+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:01:23.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.015+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:01:23.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.019+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:01:23.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.023+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:01:23.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.027+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:01:23.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.035+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:01:23.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.067+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:01:23.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.067+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:01:23.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:01:23.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.131+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:01:23.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.147+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:01:23.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.147+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:23.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:01:23.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.183+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:01:23.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.191+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:01:23.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.199+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:23.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.227+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:01:23.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.231+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:01:23.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.239+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:01:23.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.243+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:01:23.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.255+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:01:23.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.275+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:01:23.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.307+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:01:23.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.327+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:01:23.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.331+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:01:23.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.335+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:01:23.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.371+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T15:01:23.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 265 16 2895448 2895432 682.826 691.5 0.000979245 0.00145467 2024-09-16T15:01:23.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:01:23.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:01:23.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.383+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T15:01:23.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.395+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:01:23.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.395+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:01:23.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.435+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:01:23.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.443+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:01:23.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.479+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:01:23.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.483+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:01:23.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.495+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T15:01:23.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.499+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:01:23.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.507+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:01:23.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.539+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T15:01:23.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.563+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:01:23.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.567+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:01:23.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.575+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:01:23.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.579+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:01:23.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.579+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:01:23.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.615+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:23.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.651+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:01:23.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.675+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:23.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.703+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:01:23.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.707+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:01:23.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.731+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:01:23.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.747+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:01:23.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.751+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:01:23.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.751+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:01:23.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.767+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T15:01:23.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.783+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:01:23.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.799+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:01:23.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.827+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:01:23.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.839+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:01:23.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.855+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:01:23.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.855+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:01:23.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.867+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:01:23.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.895+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:01:23.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.895+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:01:23.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.903+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:01:23.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.903+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:01:23.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.915+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:01:23.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.959+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:01:23.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.967+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:23.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:23.971+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:01:24.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.003+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:01:24.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.003+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:01:24.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.007+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:01:24.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.019+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:01:24.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.035+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:01:24.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.071+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:01:24.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.103+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:01:24.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.139+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:01:24.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.147+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:01:24.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.159+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T15:01:24.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.159+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:01:24.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.159+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T15:01:24.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.167+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T15:01:24.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.195+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:01:24.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.219+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:01:24.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.227+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:01:24.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.227+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:01:24.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.231+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:01:24.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.255+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:24.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.263+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:01:24.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.283+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:24.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.287+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:01:24.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.287+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T15:01:24.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.291+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:01:24.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.311+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:01:24.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.331+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:01:24.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.335+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:01:24.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.351+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:01:24.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.355+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:01:24.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.359+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:01:24.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 266 16 2906259 2906243 682.799 675.688 0.00105463 0.00145471 2024-09-16T15:01:24.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.387+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:01:24.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.399+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:01:24.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.415+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:01:24.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.427+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:01:24.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.431+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:01:24.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.459+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:01:24.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.471+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:01:24.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.483+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:01:24.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T15:01:24.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T15:01:24.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.503+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:01:24.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.527+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:24.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.567+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:01:24.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.571+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:01:24.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.595+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:01:24.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.595+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:24.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.603+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:01:24.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.615+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:01:24.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.619+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:01:24.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:01:24.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:01:24.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.671+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T15:01:24.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.695+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:01:24.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.711+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:01:24.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.723+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:01:24.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.723+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:24.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.747+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:24.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.751+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:01:24.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.755+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T15:01:24.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.787+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:01:24.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.787+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:01:24.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:01:24.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.847+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:01:24.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.847+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:24.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.851+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:01:24.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.859+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:01:24.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.863+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:01:24.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.903+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:01:24.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.915+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:24.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.927+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:01:24.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.947+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:01:24.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.963+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:24.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.963+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:01:24.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.967+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:01:24.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.987+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:01:25.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:24.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:01:25.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.027+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:01:25.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.035+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:01:25.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.043+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:01:25.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.043+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:01:25.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.047+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:01:25.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.063+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T15:01:25.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.071+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:01:25.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.083+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:01:25.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.083+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:01:25.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.107+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:25.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.111+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:01:25.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.115+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:01:25.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.159+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:01:25.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.183+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:01:25.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.203+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T15:01:25.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.211+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:01:25.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.211+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:01:25.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.231+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:01:25.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.239+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:01:25.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.251+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:01:25.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.255+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:01:25.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.259+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:01:25.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.271+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:01:25.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.299+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:01:25.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.315+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:01:25.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.315+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:01:25.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.315+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:01:25.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.343+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:01:25.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.359+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:01:25.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 267 16 2917064 2917048 682.771 675.312 0.000861538 0.00145478 2024-09-16T15:01:25.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:01:25.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.383+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:01:25.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.407+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:01:25.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.411+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:01:25.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.443+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:01:25.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.455+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T15:01:25.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.475+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:01:25.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.491+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1e26535:::benchmark_data_smithi116_28801_object2269:head, will try copies on 2,3 2024-09-16T15:01:25.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.499+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T15:01:25.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.499+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:01:25.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:01:25.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.531+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:01:25.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.539+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:01:25.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.555+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:01:25.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.587+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:01:25.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.595+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:01:25.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.607+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:01:25.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.619+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T15:01:25.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.639+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:01:25.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.647+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:01:25.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.655+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:01:25.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.675+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:01:25.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.675+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T15:01:25.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.675+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:01:25.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:01:25.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.707+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:01:25.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.739+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:01:25.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.759+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:01:25.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.759+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T15:01:25.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.767+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:01:25.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.767+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:01:25.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.779+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:01:25.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.791+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T15:01:25.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.819+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:01:25.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.831+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:01:25.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.835+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:01:25.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.855+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:01:25.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.855+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T15:01:25.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.859+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:01:25.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.891+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:01:25.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.903+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T15:01:25.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.903+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:01:25.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.915+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T15:01:25.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.951+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T15:01:25.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:25.975+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T15:01:26.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.003+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:01:26.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:01:26.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.007+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:26.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.043+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:01:26.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.063+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:01:26.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.063+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:01:26.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.067+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:01:26.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:01:26.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.099+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:01:26.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.115+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:26.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.119+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:01:26.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.147+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T15:01:26.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.159+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:01:26.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.183+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:01:26.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.199+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:01:26.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.199+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:01:26.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.199+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:01:26.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.219+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:01:26.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.223+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:01:26.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.255+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T15:01:26.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.267+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:26.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.275+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T15:01:26.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.283+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:01:26.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.287+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:01:26.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.299+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:01:26.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.299+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:01:26.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.323+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:01:26.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.327+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:01:26.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.331+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:01:26.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.367+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:01:26.377 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 268 15 2928072 2928057 682.791 688.062 0.000946716 0.00145473 2024-09-16T15:01:26.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.375+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:01:26.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.387+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:01:26.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.423+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:01:26.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.435+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:26.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.439+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:01:26.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.443+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:01:26.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.443+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:01:26.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.467+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:01:26.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.471+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:01:26.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.471+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:01:26.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.483+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:01:26.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.483+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:01:26.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:01:26.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.531+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:01:26.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.535+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:01:26.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.567+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:01:26.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.571+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:01:26.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.579+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:01:26.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.587+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:01:26.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.595+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:01:26.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.615+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:01:26.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.651+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:01:26.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.659+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T15:01:26.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:26.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.691+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:01:26.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.703+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:01:26.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.711+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T15:01:26.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.727+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:01:26.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.727+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T15:01:26.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.763+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:26.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.779+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:26.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.799+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:01:26.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.799+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:01:26.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.827+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:01:26.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.835+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:01:26.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.887+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:01:26.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.927+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:01:26.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.951+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:26.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.963+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:01:26.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.979+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:01:27.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:26.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:01:27.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.003+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:01:27.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.015+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:01:27.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.019+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:01:27.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.059+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:01:27.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T15:01:27.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.127+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:01:27.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.127+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:01:27.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.155+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:01:27.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.171+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:01:27.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.195+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:01:27.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.215+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:01:27.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.223+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T15:01:27.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.243+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:01:27.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.263+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:01:27.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.267+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:01:27.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.291+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T15:01:27.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.291+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T15:01:27.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.291+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:01:27.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.299+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:01:27.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.327+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:01:27.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.331+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:01:27.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.339+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:01:27.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.343+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T15:01:27.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.363+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:01:27.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 269 16 2938743 2938727 682.731 666.875 0.000749043 0.00145486 2024-09-16T15:01:27.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.391+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:01:27.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.407+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:01:27.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.411+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T15:01:27.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.431+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:01:27.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.459+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:01:27.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.459+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:01:27.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.463+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:01:27.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.483+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:01:27.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.491+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:01:27.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.499+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T15:01:27.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:01:27.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.515+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:01:27.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.531+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:01:27.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.543+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T15:01:27.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.583+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:01:27.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.599+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T15:01:27.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.603+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:27.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T15:01:27.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.619+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:01:27.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.651+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:01:27.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.659+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:01:27.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.695+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:01:27.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.707+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:01:27.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.711+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:01:27.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.715+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:01:27.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.727+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T15:01:27.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.747+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:01:27.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.755+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:01:27.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.759+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:01:27.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.763+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:01:27.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.775+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T15:01:27.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.823+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:27.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.839+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:27.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.859+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:01:27.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:01:27.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.875+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:01:27.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.883+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:01:27.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.911+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:01:27.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.923+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:27.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.927+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:01:27.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.939+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:01:27.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.943+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T15:01:27.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.955+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:27.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.959+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:01:27.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.967+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:01:28.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:27.999+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:01:28.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.015+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:01:28.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.019+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:01:28.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.047+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:01:28.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.059+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:01:28.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.071+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:28.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.075+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:01:28.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.091+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:01:28.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.103+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:01:28.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.107+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:01:28.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.119+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:28.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.159+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:01:28.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.171+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:01:28.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.195+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:01:28.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.203+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:01:28.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.215+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:01:28.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T15:01:28.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.251+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:01:28.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.255+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T15:01:28.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.255+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:28.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.287+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:01:28.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.303+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T15:01:28.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.323+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:01:28.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.347+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:01:28.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.351+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:01:28.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.363+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:01:28.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:01:28.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.371+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:01:28.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 270 16 2949574 2949558 682.71 676.938 0.00427216 0.00145491 2024-09-16T15:01:28.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.391+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:01:28.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.395+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:01:28.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.415+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:01:28.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.419+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:28.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.419+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:01:28.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.427+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:01:28.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.443+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:01:28.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.443+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:01:28.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.511+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:01:28.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.519+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:01:28.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.547+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:01:28.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.563+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:01:28.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:28.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:28.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.591+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:28.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.607+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:01:28.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.639+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:01:28.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.663+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:01:28.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.663+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:28.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.703+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:01:28.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:01:28.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.707+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:28.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.731+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:01:28.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.739+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:01:28.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.771+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T15:01:28.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.771+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:01:28.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.783+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:01:28.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.827+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:01:28.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.839+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T15:01:28.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.847+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:01:28.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.859+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T15:01:28.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.867+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:01:28.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.887+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:01:28.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.895+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:01:28.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.915+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:01:28.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.931+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:01:28.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.995+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:01:29.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:28.995+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:01:29.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.015+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:01:29.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.035+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:01:29.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.039+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:01:29.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.063+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:01:29.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.067+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:01:29.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.087+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:01:29.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.095+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:01:29.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.107+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:01:29.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.123+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:01:29.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.135+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:01:29.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.151+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:01:29.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.191+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:01:29.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.191+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:01:29.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.207+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T15:01:29.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.219+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:01:29.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.219+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:01:29.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.251+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:01:29.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.251+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:01:29.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.251+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:29.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.279+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:01:29.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.283+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:01:29.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.323+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:01:29.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.323+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:01:29.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.343+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:01:29.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 271 16 2960852 2960836 682.791 704.875 0.000983671 0.00145475 2024-09-16T15:01:29.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:01:29.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.379+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:01:29.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.391+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:01:29.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.399+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:01:29.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.435+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:01:29.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.439+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:01:29.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.451+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:01:29.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.455+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:01:29.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.467+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:01:29.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.491+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T15:01:29.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.503+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:01:29.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.511+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:01:29.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.531+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:01:29.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.539+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:01:29.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.547+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:01:29.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.567+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:01:29.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.607+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:01:29.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.607+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:01:29.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.623+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:01:29.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.635+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:01:29.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.635+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:01:29.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.643+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:01:29.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.663+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:01:29.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.671+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:01:29.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.683+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:01:29.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.695+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T15:01:29.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.707+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:29.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.719+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:01:29.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.727+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:01:29.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.755+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:01:29.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.763+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:01:29.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.791+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:01:29.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.795+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:01:29.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:01:29.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.823+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:01:29.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:01:29.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.835+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:01:29.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.863+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:01:29.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.895+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:01:29.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.903+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:01:29.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.927+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:29.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.931+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:01:29.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.939+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T15:01:29.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.947+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:01:29.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.947+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:01:29.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.947+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:29.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.963+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:01:29.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.975+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:01:29.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.975+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T15:01:29.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.991+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:01:30.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:29.999+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:01:30.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.039+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:01:30.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.047+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:01:30.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.067+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:01:30.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.075+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:01:30.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.091+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:01:30.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.115+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:01:30.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.123+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:01:30.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.127+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665e95ea:::benchmark_data_smithi116_28801_object1992:head, will try copies on 3,4 2024-09-16T15:01:30.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.127+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:01:30.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.147+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:30.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.159+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:01:30.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.179+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:01:30.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:01:30.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.187+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:01:30.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.211+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:01:30.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.227+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:01:30.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.231+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:01:30.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.243+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:01:30.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.247+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:01:30.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.247+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T15:01:30.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.263+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:01:30.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.283+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:01:30.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.299+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:01:30.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:01:30.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.339+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:30.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.355+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:01:30.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.355+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:01:30.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 272 16 2971779 2971763 682.791 682.938 0.000945204 0.00145474 2024-09-16T15:01:30.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.387+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:01:30.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.387+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:01:30.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.411+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:01:30.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.415+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:01:30.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.419+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:01:30.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.455+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:01:30.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.459+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:01:30.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.475+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:01:30.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.475+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:30.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.503+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:01:30.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.519+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:30.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.523+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:01:30.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:01:30.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.543+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:01:30.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.547+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:01:30.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.587+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:01:30.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.607+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:01:30.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.607+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T15:01:30.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.623+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:01:30.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.627+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:01:30.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.643+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:01:30.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.667+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:30.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.687+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:01:30.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.687+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:01:30.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.715+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:01:30.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.719+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:01:30.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.723+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:01:30.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.743+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:01:30.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.763+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:30.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.767+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:01:30.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:01:30.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.811+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:01:30.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.811+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:01:30.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.815+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T15:01:30.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.835+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a523f3:::benchmark_data_smithi116_28801_object3519:head, will try copies on 2,3 2024-09-16T15:01:30.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.863+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:01:30.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.871+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T15:01:30.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.879+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:01:30.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.891+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:30.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.903+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T15:01:30.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.907+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:01:30.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.907+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:01:30.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.911+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:01:30.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.935+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:01:30.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.955+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:30.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.967+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:01:30.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.987+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:01:31.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:30.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:01:31.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.035+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:01:31.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.043+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T15:01:31.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.067+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:01:31.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.079+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:01:31.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.103+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:01:31.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.111+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:01:31.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.123+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:31.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.171+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:01:31.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.179+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:01:31.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.207+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:31.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.207+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:01:31.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.207+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:01:31.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T15:01:31.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.215+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:01:31.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.223+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:01:31.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.259+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:01:31.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.271+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:01:31.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.299+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:01:31.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.307+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:01:31.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:01:31.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.339+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:01:31.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:01:31.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.363+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:31.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.367+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:01:31.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 273 16 2982706 2982690 682.792 682.938 0.0038556 0.00145474 2024-09-16T15:01:31.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.379+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:31.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.403+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:01:31.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.407+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:01:31.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.411+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655723de:::benchmark_data_smithi116_28801_object3111:head, will try copies on 3,4 2024-09-16T15:01:31.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.427+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:01:31.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.451+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:01:31.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:01:31.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.471+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:01:31.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.479+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:01:31.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.487+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:31.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.507+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:01:31.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.519+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:01:31.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.519+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:31.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.547+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:01:31.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.551+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T15:01:31.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.559+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:01:31.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.567+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:01:31.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.599+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:31.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.607+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:01:31.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.611+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:01:31.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.631+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:01:31.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.643+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:31.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.647+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:01:31.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.647+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:01:31.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.671+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:01:31.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.679+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T15:01:31.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.691+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:01:31.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.711+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:01:31.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.711+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:01:31.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.715+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T15:01:31.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.715+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:01:31.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.751+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:01:31.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.767+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:01:31.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:01:31.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.783+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T15:01:31.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.811+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:01:31.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.815+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:01:31.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.823+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:31.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:01:31.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.843+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:01:31.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.963+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:32.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:31.999+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:01:32.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.003+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:01:32.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.011+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:01:32.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.015+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:01:32.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.023+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:01:32.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.035+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:01:32.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.055+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:01:32.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.059+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:01:32.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.095+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:01:32.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.111+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:01:32.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.123+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:01:32.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.123+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:01:32.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.143+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:01:32.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.163+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:01:32.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.163+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T15:01:32.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.215+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:01:32.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:01:32.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.251+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T15:01:32.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.267+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:01:32.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.275+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T15:01:32.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.287+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:01:32.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.299+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T15:01:32.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.315+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:32.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.343+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T15:01:32.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.355+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:01:32.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 274 15 2992130 2992115 682.45 589.062 0.000624014 0.00145547 2024-09-16T15:01:32.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T15:01:32.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.379+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:01:32.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.387+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:01:32.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.391+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:01:32.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.427+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:01:32.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.459+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T15:01:32.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.471+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T15:01:32.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.491+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:01:32.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.515+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:32.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.539+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:01:32.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.539+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:01:32.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.571+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:01:32.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.579+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:01:32.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.595+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:01:32.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.619+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T15:01:32.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.623+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:01:32.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.627+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:01:32.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.663+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:01:32.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.675+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:01:32.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.675+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:01:32.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.695+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:01:32.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:01:32.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.715+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:01:32.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.743+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T15:01:32.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.759+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:01:32.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.763+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:01:32.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.771+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:32.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.811+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:01:32.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.815+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:01:32.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T15:01:32.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.851+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:01:32.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.855+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:01:32.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.871+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:01:32.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.879+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:01:32.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.899+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:01:32.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.911+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:01:32.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.915+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:01:32.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.935+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:01:32.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.963+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T15:01:32.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.979+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:01:32.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.983+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T15:01:32.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.991+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:01:33.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:32.999+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca5bb23:::benchmark_data_smithi116_28801_object1704:head, will try copies on 0,4 2024-09-16T15:01:33.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.007+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:01:33.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.011+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:01:33.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.043+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:01:33.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.043+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:01:33.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.047+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:01:33.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.107+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:01:33.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.123+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:33.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.151+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:33.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.163+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T15:01:33.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.175+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:01:33.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.179+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:33.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.223+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:01:33.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.223+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e93b169:::benchmark_data_smithi116_28801_object1113:head, will try copies on 3,4 2024-09-16T15:01:33.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:01:33.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.251+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:33.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.255+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:01:33.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.271+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:01:33.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.303+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:01:33.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.327+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:01:33.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.339+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:01:33.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:01:33.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.371+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5427d486:::benchmark_data_smithi116_28801_object2734:head, will try copies on 3,4 2024-09-16T15:01:33.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.375+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:01:33.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.375+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:01:33.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 275 16 3003538 3003522 682.56 712.938 0.00128043 0.00145524 2024-09-16T15:01:33.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.403+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:33.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.407+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:01:33.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:01:33.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.459+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:01:33.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.459+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:01:33.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.483+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:01:33.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.491+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:01:33.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.499+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:01:33.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.499+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:01:33.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.503+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:01:33.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.523+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:33.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.535+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:01:33.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.539+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:33.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.579+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:01:33.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.599+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:01:33.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.607+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:01:33.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.611+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:01:33.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.619+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:01:33.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.639+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:01:33.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.655+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:01:33.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.687+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:01:33.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.691+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:01:33.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.711+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:01:33.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.731+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:01:33.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.731+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:01:33.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.755+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:01:33.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.763+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:01:33.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.775+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:33.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.779+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T15:01:33.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.795+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:01:33.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.803+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:01:33.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.815+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:01:33.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.827+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:01:33.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.831+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:33.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.839+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:01:33.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.875+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:01:33.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.875+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:01:33.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.895+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:01:33.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:01:33.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.919+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T15:01:33.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:01:33.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.959+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:01:33.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.971+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:01:33.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.971+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:01:33.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.979+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:01:33.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:33.987+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T15:01:34.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.019+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T15:01:34.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.031+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T15:01:34.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.059+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:01:34.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.063+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:01:34.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.075+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:01:34.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.095+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:01:34.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.095+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:01:34.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.099+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:01:34.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.123+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:34.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.123+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:01:34.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.163+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:01:34.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.167+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:01:34.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.191+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:01:34.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.231+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:01:34.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.231+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:01:34.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.243+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:34.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.251+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:01:34.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.259+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:01:34.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.287+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T15:01:34.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:01:34.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.307+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:01:34.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.307+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:01:34.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.327+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:01:34.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.347+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:01:34.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.351+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:01:34.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.363+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T15:01:34.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 276 16 3014330 3014314 682.531 674.5 0.00479808 0.0014553 2024-09-16T15:01:34.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.383+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:01:34.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.399+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T15:01:34.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.411+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T15:01:34.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.415+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:01:34.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.427+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T15:01:34.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.443+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:01:34.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.447+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:01:34.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.483+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:01:34.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.499+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:01:34.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.519+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:01:34.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.539+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:01:34.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.543+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:01:34.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.575+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:01:34.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.579+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:01:34.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.595+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:01:34.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.615+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:01:34.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.635+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T15:01:34.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.651+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:01:34.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.659+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:01:34.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.675+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:01:34.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.695+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:01:34.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.695+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:01:34.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.703+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:01:34.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.747+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:01:34.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.751+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T15:01:34.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.755+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:01:34.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.767+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:01:34.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.787+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:34.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.803+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:01:34.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.803+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T15:01:34.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.839+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:01:34.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.847+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:01:34.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.859+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:34.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.899+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:01:34.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:01:34.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.927+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:01:34.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.939+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:01:34.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.971+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T15:01:34.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.971+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:01:34.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:34.983+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:35.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.003+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:01:35.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.019+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:01:35.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.027+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:01:35.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.039+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:01:35.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.063+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:01:35.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:01:35.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.075+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:01:35.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.091+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:01:35.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.119+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:01:35.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.123+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be737a:::benchmark_data_smithi116_28801_object398:head, will try copies on 3,4 2024-09-16T15:01:35.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:01:35.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.147+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:01:35.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.163+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:01:35.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.175+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:01:35.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.207+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:01:35.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.235+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:01:35.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.235+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:01:35.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.271+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:01:35.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.295+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:01:35.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.311+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:01:35.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.319+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:01:35.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.335+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:01:35.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.335+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:01:35.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:01:35.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 277 16 3025660 3025644 682.623 708.125 0.00160032 0.0014551 2024-09-16T15:01:35.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.383+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:35.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.383+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:35.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.399+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:01:35.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.403+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:01:35.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.447+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:01:35.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.467+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:01:35.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.467+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:01:35.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.475+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:01:35.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.479+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:01:35.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:01:35.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.503+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T15:01:35.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:01:35.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.551+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:01:35.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.579+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T15:01:35.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.583+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:01:35.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:01:35.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:01:35.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.615+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T15:01:35.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.631+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:01:35.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.639+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T15:01:35.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.659+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:01:35.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.659+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:01:35.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.663+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:01:35.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.675+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:01:35.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.683+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:01:35.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.699+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:01:35.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.703+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:01:35.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.727+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:01:35.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.743+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:01:35.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.751+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T15:01:35.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.755+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:01:35.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.759+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:01:35.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.787+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:01:35.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.803+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:01:35.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.811+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:35.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.835+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:35.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.835+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:01:35.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.847+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:01:35.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.863+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:01:35.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.871+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:01:35.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.879+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:01:35.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.883+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:01:35.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.887+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:01:35.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.903+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:01:35.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:35.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.931+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:01:35.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.947+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:01:35.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.959+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:01:35.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.963+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:01:35.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.971+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:01:35.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:35.983+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T15:01:36.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.015+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:01:36.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.051+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:01:36.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.103+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:01:36.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.107+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:01:36.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.123+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:01:36.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.131+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:01:36.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.147+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:01:36.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.155+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:01:36.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.175+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:01:36.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.183+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:01:36.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.223+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:01:36.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.243+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:01:36.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.247+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:01:36.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.259+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:01:36.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.283+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:01:36.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.307+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:01:36.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.311+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:01:36.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.315+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:36.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.319+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:01:36.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.323+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:01:36.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.347+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:36.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.363+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:01:36.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.367+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:36.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 278 16 3036634 3036618 682.635 685.875 0.00121848 0.00145506 2024-09-16T15:01:36.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.403+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:01:36.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.403+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:01:36.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.403+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T15:01:36.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.407+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:01:36.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.411+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:36.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.467+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:01:36.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.467+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:01:36.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.491+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T15:01:36.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.503+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:01:36.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:01:36.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.535+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:01:36.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.547+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b335210:::benchmark_data_smithi116_28801_object1355:head, will try copies on 3,4 2024-09-16T15:01:36.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.563+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:01:36.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.583+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:36.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.583+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:01:36.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.599+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:01:36.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.615+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:01:36.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.619+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:01:36.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.623+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:01:36.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:01:36.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.671+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T15:01:36.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.695+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:01:36.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.699+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:01:36.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.711+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:01:36.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.731+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:01:36.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.735+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:01:36.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.739+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:01:36.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:01:36.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.787+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:01:36.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.795+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:01:36.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.803+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:01:36.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.819+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:01:36.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.831+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:01:36.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:01:36.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.879+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:36.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.887+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:01:36.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.911+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:01:36.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.915+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:01:36.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.939+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:01:36.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.943+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:01:36.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.967+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T15:01:37.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:36.995+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:01:37.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:01:37.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.027+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:01:37.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:01:37.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.059+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:01:37.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:01:37.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.071+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T15:01:37.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.103+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:01:37.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.107+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:37.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.143+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:01:37.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.175+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:01:37.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.195+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:01:37.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.215+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:01:37.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.215+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:01:37.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.219+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:01:37.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.227+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:01:37.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.231+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:01:37.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.239+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:37.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.275+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:37.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.291+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:01:37.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.299+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:01:37.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.303+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:01:37.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.323+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:01:37.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.343+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:01:37.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:01:37.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.351+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:01:37.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.363+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:01:37.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 279 16 3047759 3047743 682.68 695.312 0.00058693 0.00145497 2024-09-16T15:01:37.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:01:37.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.395+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:01:37.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.419+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:01:37.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.439+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:37.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.463+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:01:37.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.471+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:01:37.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T15:01:37.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.503+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:01:37.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T15:01:37.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.527+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:37.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.579+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:01:37.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.583+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:01:37.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.607+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:01:37.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.619+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:01:37.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.627+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:01:37.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.635+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:01:37.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.643+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:01:37.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.643+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:01:37.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.651+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:01:37.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.675+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:01:37.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.715+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:01:37.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.723+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:01:37.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.735+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:01:37.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.735+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:01:37.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.755+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:01:37.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.771+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:01:37.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.787+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T15:01:37.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.795+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:01:37.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.799+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:01:37.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.819+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:01:37.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.823+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:01:37.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.827+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:01:37.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.867+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:37.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.875+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:37.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.875+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:01:37.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.883+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:01:37.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.947+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:01:37.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.967+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:01:37.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.971+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:01:37.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.975+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:01:37.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.979+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:01:37.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.991+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:01:38.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:37.999+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:01:38.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.023+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:01:38.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.035+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:01:38.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.043+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:01:38.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.067+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:01:38.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.087+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:01:38.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.115+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:38.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.123+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:01:38.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:01:38.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.139+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:01:38.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.143+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:01:38.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.167+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:01:38.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:01:38.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.207+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:01:38.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.215+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:01:38.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.219+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:01:38.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.227+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:01:38.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.227+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:01:38.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.243+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:01:38.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.259+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:01:38.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.275+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:01:38.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.295+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:01:38.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.295+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:01:38.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.303+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:01:38.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.323+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:01:38.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.335+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T15:01:38.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.339+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:01:38.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.371+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:01:38.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:01:38.379469+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.0014549 2024-09-16T15:01:38.378 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:01:38.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 280 15 3058805 3058790 682.707 690.438 0.00418952 0.0014549 2024-09-16T15:01:38.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.391+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:01:38.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.391+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T15:01:38.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.395+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:01:38.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.427+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:01:38.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.455+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:01:38.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.463+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:01:38.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.499+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6368902c:::benchmark_data_smithi116_28801_object219:head, will try copies on 3,4 2024-09-16T15:01:38.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.515+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:01:38.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.535+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:01:38.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.563+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:01:38.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.575+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:01:38.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.575+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:01:38.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.595+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:01:38.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:01:38.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.611+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:01:38.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.627+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T15:01:38.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.631+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:01:38.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.655+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T15:01:38.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.663+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:01:38.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.667+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:01:38.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.679+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:38.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.695+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:01:38.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.707+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:01:38.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.727+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:01:38.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.731+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:01:38.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.759+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:01:38.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.767+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:01:38.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.775+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:01:38.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:01:38.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.823+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:01:38.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.827+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:01:38.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.827+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:01:38.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.855+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:01:38.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.875+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:01:38.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.903+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:01:38.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.919+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:01:38.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.939+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:01:38.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.959+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:01:38.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.959+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:38.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.975+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:01:38.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.983+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:01:38.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.995+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:01:39.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:38.995+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:01:39.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.015+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:01:39.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.019+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:01:39.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.055+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:01:39.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.055+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:01:39.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.067+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:01:39.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.071+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T15:01:39.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.075+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:01:39.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.115+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T15:01:39.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.119+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:01:39.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.143+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:01:39.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.151+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940decd9:::benchmark_data_smithi116_28801_object3011:head, will try copies on 0,4 2024-09-16T15:01:39.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.159+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:01:39.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.159+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:01:39.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.163+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:01:39.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.191+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:01:39.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.211+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:01:39.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.211+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:01:39.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.219+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:01:39.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.243+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:01:39.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.251+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:01:39.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.255+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:01:39.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.267+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:01:39.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.271+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:01:39.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.295+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:01:39.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.315+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:01:39.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.319+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:01:39.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.339+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:39.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 281 16 3069661 3069645 682.692 678.438 0.00200646 0.00145495 2024-09-16T15:01:39.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.375+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:01:39.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.387+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:01:39.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.395+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:39.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.439+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:39.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.443+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:01:39.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:01:39.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.467+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:01:39.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.467+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:39.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.487+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:01:39.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.491+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:01:39.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.499+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:01:39.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.523+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:01:39.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.531+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:01:39.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.543+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:01:39.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.567+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T15:01:39.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.571+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:01:39.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.583+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:01:39.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.587+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T15:01:39.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.623+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T15:01:39.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.663+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:01:39.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.687+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:01:39.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.699+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:01:39.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:01:39.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.739+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:01:39.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.743+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:01:39.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.759+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:01:39.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.771+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T15:01:39.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.771+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:01:39.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.775+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:01:39.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7e86ba:::benchmark_data_smithi116_28801_object1945:head, will try copies on 0,4 2024-09-16T15:01:39.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.823+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:01:39.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.851+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:01:39.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.863+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:01:39.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.891+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:01:39.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.907+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:01:39.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.919+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:01:39.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.935+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:01:39.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.947+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:01:39.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.967+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:01:39.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.971+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:01:39.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.975+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:39.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:39.991+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:01:40.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.011+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:01:40.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.023+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:40.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.039+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:01:40.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.047+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:01:40.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.055+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:01:40.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.095+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T15:01:40.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.107+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:01:40.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.111+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:01:40.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.131+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:01:40.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.135+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:01:40.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.135+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:01:40.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.139+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:40.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.143+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:01:40.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.179+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:01:40.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:01:40.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.203+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:01:40.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.223+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T15:01:40.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:01:40.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.271+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:01:40.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.275+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:01:40.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.287+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T15:01:40.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.307+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:01:40.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.307+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:01:40.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.315+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T15:01:40.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.367+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:01:40.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.367+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T15:01:40.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 282 15 3080863 3080848 682.754 700.188 0.000993275 0.00145482 2024-09-16T15:01:40.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.375+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:01:40.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.387+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:01:40.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.399+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:01:40.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.427+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:01:40.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.439+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:01:40.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.443+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:01:40.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.471+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:01:40.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.487+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:01:40.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.503+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:01:40.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.507+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:40.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.515+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:01:40.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.527+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:01:40.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.551+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:01:40.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.555+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:01:40.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.575+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:01:40.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.599+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:01:40.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.623+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:01:40.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.635+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:01:40.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.639+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T15:01:40.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.659+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:01:40.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.675+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:01:40.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.691+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:01:40.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.699+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:01:40.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.727+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:01:40.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.727+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:01:40.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.727+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:01:40.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.739+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:01:40.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.743+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:01:40.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.763+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:01:40.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.803+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T15:01:40.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.803+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:01:40.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.823+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:01:40.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.835+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:01:40.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.843+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:01:40.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.859+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:01:40.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.879+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:01:40.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.883+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:01:40.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.899+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:40.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.907+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:01:40.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.927+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:01:40.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.955+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:01:40.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.959+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:01:40.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.971+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:01:40.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.975+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:01:40.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.983+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:01:40.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.983+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:01:41.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:40.999+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:01:41.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.047+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:01:41.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.055+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:01:41.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.055+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T15:01:41.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.079+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:01:41.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:01:41.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.099+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:01:41.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.119+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:41.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.123+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T15:01:41.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.123+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:01:41.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.131+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:01:41.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.155+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:01:41.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.167+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T15:01:41.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:01:41.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:01:41.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.223+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:01:41.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.223+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T15:01:41.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.243+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:01:41.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.271+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:01:41.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.271+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:01:41.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.299+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T15:01:41.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.319+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:01:41.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.335+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:01:41.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.339+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:01:41.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.339+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:01:41.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.359+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:01:41.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 283 16 3091752 3091736 682.746 680.5 0.000921848 0.00145483 2024-09-16T15:01:41.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.387+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:01:41.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.387+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:01:41.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.391+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:01:41.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.395+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:01:41.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.403+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:41.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.415+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:01:41.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.435+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:535d1bd1:::benchmark_data_smithi116_28801_object76:head, will try copies on 3,4 2024-09-16T15:01:41.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.443+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:01:41.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.447+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T15:01:41.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.495+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:01:41.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.499+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:01:41.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.515+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:01:41.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.523+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:01:41.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.543+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:667135ab:::benchmark_data_smithi116_28801_object895:head, will try copies on 3,4 2024-09-16T15:01:41.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.575+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:01:41.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.575+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:41.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.579+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:01:41.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.583+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:01:41.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.611+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:01:41.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.631+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:01:41.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.631+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:01:41.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.635+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:01:41.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.639+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:01:41.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.651+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:01:41.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.671+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:01:41.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.695+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:01:41.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.727+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:01:41.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.739+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:01:41.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.775+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:41.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.775+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:01:41.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.795+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:01:41.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.795+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:01:41.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.811+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T15:01:41.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.819+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:01:41.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.823+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T15:01:41.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.847+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T15:01:41.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.859+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:01:41.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:01:41.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.891+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:01:41.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:41.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.915+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:01:41.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.939+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:01:41.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.959+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:01:41.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.971+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:01:41.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:41.971+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:01:42.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.003+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:01:42.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.007+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:01:42.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:01:42.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.043+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:01:42.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.047+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:01:42.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.059+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:01:42.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.067+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:01:42.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.079+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:42.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.103+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:01:42.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.107+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:01:42.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.107+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T15:01:42.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.111+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:01:42.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.147+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T15:01:42.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.163+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T15:01:42.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.195+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:01:42.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.199+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:01:42.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.203+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:01:42.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.227+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:01:42.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.251+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T15:01:42.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:01:42.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.323+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:01:42.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.335+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:01:42.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.355+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:01:42.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.359+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:42.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.363+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:01:42.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 284 15 3102112 3102097 682.622 647.562 0.00133858 0.0014551 2024-09-16T15:01:42.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.379+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:01:42.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.415+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:01:42.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.423+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:01:42.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.435+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:01:42.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.455+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:01:42.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:01:42.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:01:42.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.519+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:01:42.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:01:42.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.523+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:01:42.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.563+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:01:42.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.591+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:01:42.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:01:42.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.607+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:42.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.615+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:01:42.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:01:42.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.663+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:01:42.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.667+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T15:01:42.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.683+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:01:42.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.687+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T15:01:42.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.711+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:42.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.711+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:01:42.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.719+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:01:42.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.763+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:42.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.771+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:01:42.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.795+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:42.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.799+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:01:42.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.803+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:01:42.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.819+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:01:42.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.831+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:01:42.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.843+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:01:42.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.855+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:01:42.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.871+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:01:42.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.907+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:01:42.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.939+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T15:01:42.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.943+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:01:42.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.951+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:01:42.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.955+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:01:43.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.999+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:01:43.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:42.999+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:01:43.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.035+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:01:43.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.035+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:01:43.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.055+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T15:01:43.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.079+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:43.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.107+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:01:43.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.115+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T15:01:43.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.127+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:43.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.127+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:01:43.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.135+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:43.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:01:43.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.199+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:01:43.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:01:43.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.219+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:01:43.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.219+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:01:43.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:01:43.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.247+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:01:43.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.259+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:01:43.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.279+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:01:43.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.279+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T15:01:43.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.307+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:01:43.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.311+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:01:43.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.323+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:43.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.351+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:01:43.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.351+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:01:43.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.355+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:01:43.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.359+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:01:43.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 285 16 3113387 3113371 682.699 704.625 0.000627634 0.00145492 2024-09-16T15:01:43.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.419+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:01:43.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.435+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:43.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.459+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:01:43.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.471+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T15:01:43.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.479+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:43.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.503+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:01:43.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.527+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be70c536:::benchmark_data_smithi116_28801_object3692:head, will try copies on 2,3 2024-09-16T15:01:43.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.527+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:01:43.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.539+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:01:43.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.559+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:01:43.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.575+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:01:43.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.595+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:43.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.603+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:01:43.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.635+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:01:43.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.643+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:01:43.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.679+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:01:43.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.679+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:01:43.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.683+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:01:43.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.715+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:01:43.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.751+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:01:43.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.755+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:01:43.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.759+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:01:43.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.791+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:01:43.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.819+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T15:01:43.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.871+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:01:43.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.895+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:01:43.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:01:43.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.903+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:01:43.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.923+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f35937:::benchmark_data_smithi116_28801_object2437:head, will try copies on 2,3 2024-09-16T15:01:43.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.951+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:01:43.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.959+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:01:43.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.959+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:01:43.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.971+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:01:43.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:43.979+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68995246:::benchmark_data_smithi116_28801_object51:head, will try copies on 3,4 2024-09-16T15:01:44.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.015+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:44.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.027+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:01:44.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.043+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:01:44.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.043+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:01:44.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.051+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:01:44.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.079+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:01:44.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.091+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b29cb309:::benchmark_data_smithi116_28801_object968:head, will try copies on 2,3 2024-09-16T15:01:44.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.103+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:01:44.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.119+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:01:44.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.135+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:01:44.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.151+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:01:44.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.175+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:01:44.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.187+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:01:44.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.207+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:01:44.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.211+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:01:44.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.211+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:01:44.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.223+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:01:44.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.239+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:01:44.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.267+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:01:44.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.283+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:01:44.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.303+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:01:44.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.307+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:01:44.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.319+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:01:44.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.335+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T15:01:44.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:01:44.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.375+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:01:44.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 286 16 3124589 3124573 682.759 700.125 0.00130219 0.00145481 2024-09-16T15:01:44.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.395+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:01:44.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.415+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba606b76:::benchmark_data_smithi116_28801_object3515:head, will try copies on 2,3 2024-09-16T15:01:44.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.415+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:01:44.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.435+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccd741:::benchmark_data_smithi116_28801_object2447:head, will try copies on 0,4 2024-09-16T15:01:44.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.455+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:01:44.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.459+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:01:44.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.475+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:01:44.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:01:44.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.511+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T15:01:44.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.515+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:01:44.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.519+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:01:44.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.543+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:01:44.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.547+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:44.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.559+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T15:01:44.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.575+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:01:44.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.579+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:01:44.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.603+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:01:44.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.615+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:01:44.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T15:01:44.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.667+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:01:44.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.667+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:01:44.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.679+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:01:44.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.683+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:01:44.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.703+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:44.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.715+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:01:44.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.719+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:01:44.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.755+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:01:44.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.783+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:01:44.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.795+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:01:44.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.799+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:01:44.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.815+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:01:44.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.831+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:01:44.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.851+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:44.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.855+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:01:44.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.859+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:44.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.867+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:01:44.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.879+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T15:01:44.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.887+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:01:44.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.911+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:01:44.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.935+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:01:44.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.939+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:01:44.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.951+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:01:44.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.975+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T15:01:44.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.983+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:01:44.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:44.987+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:01:45.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.003+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:01:45.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.007+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:01:45.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.019+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:01:45.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.023+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:01:45.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.043+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:01:45.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.071+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:01:45.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.079+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:01:45.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.091+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:01:45.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.099+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:01:45.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.131+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T15:01:45.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.131+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:01:45.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.139+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:01:45.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.147+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:01:45.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.179+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T15:01:45.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.187+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T15:01:45.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.195+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:01:45.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.215+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:01:45.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.235+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:45.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.251+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5722f0cc:::benchmark_data_smithi116_28801_object3681:head, will try copies on 3,4 2024-09-16T15:01:45.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.263+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:01:45.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.263+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:01:45.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.279+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:01:45.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:01:45.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.319+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:01:45.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.335+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:01:45.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.351+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:01:45.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.359+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:01:45.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.371+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:01:45.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 287 16 3135358 3135342 682.725 673.062 0.000569995 0.00145487 2024-09-16T15:01:45.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.383+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:01:45.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.383+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:01:45.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.407+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:01:45.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.427+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:01:45.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.435+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:01:45.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.455+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T15:01:45.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.459+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:01:45.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.467+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:01:45.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.503+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:01:45.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.511+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:01:45.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.519+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:01:45.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.535+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:01:45.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.535+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44e00bc:::benchmark_data_smithi116_28801_object4006:head, will try copies on 2,3 2024-09-16T15:01:45.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.543+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:01:45.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.559+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:01:45.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.571+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:01:45.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.591+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:01:45.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.607+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:01:45.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.631+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T15:01:45.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.655+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:01:45.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.659+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:01:45.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.691+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:01:45.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.703+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:01:45.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.731+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:01:45.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.731+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:01:45.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.743+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:01:45.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.763+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:01:45.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.775+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:01:45.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.783+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:01:45.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.795+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:01:45.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.799+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T15:01:45.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:45.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.835+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:01:45.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.887+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:01:45.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.891+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:45.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.899+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:45.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.903+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:01:45.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.911+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:01:45.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.939+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:01:45.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.959+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:01:45.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.963+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:01:45.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.979+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:01:45.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:45.987+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:01:46.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.015+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:01:46.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.019+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:01:46.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.043+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:01:46.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.063+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:01:46.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.067+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:01:46.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.071+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:01:46.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.091+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:01:46.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.099+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:01:46.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.115+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:01:46.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.119+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:01:46.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.127+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:01:46.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.163+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:01:46.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.183+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:01:46.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.187+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:01:46.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.191+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:01:46.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.231+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:01:46.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.247+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:01:46.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.255+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:01:46.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.295+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:01:46.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.303+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:01:46.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.331+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:01:46.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.343+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:01:46.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.351+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T15:01:46.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.367+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:01:46.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 288 15 3146430 3146415 682.757 692.062 0.00220135 0.00145481 2024-09-16T15:01:46.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.395+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:01:46.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.423+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:01:46.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.431+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T15:01:46.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.439+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:01:46.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.439+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:01:46.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.443+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:01:46.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.463+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T15:01:46.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.495+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:01:46.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.507+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:01:46.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.511+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:01:46.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.515+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:01:46.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.535+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:01:46.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.539+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:01:46.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.551+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:01:46.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.559+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:01:46.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.571+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:01:46.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.587+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:01:46.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.607+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:46.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.611+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:01:46.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.611+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:01:46.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.655+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T15:01:46.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.655+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:01:46.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.703+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:01:46.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.707+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:01:46.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.711+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:01:46.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.719+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T15:01:46.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.743+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:01:46.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.759+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:01:46.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.779+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:01:46.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.787+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:01:46.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.803+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:01:46.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.815+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:01:46.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.851+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:01:46.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.875+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:01:46.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.967+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:01:46.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.971+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fced8f8:::benchmark_data_smithi116_28801_object4111:head, will try copies on 3,4 2024-09-16T15:01:46.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.979+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:01:47.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.999+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:01:47.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:46.999+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:01:47.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.007+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:01:47.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.031+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T15:01:47.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.055+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:01:47.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.087+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:01:47.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.095+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:01:47.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.103+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:01:47.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.119+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:01:47.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.119+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:01:47.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.127+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:01:47.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.143+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:01:47.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.195+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:01:47.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.207+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:01:47.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:01:47.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.223+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T15:01:47.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.227+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T15:01:47.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.231+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:01:47.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.243+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:01:47.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:01:47.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 289 16 3155561 3155545 682.369 570.625 0.00196564 0.00145564 2024-09-16T15:01:47.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:01:47.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.387+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:01:47.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.411+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:01:47.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.411+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:47.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.427+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:01:47.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.435+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:01:47.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.447+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:01:47.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.459+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:01:47.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.479+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:47.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.511+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:01:47.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.563+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:01:47.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:01:47.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.591+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:01:47.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.591+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:01:47.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.595+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:01:47.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.603+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:01:47.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.631+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:01:47.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.635+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:01:47.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.651+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:01:47.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.663+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:01:47.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:01:47.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.679+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:01:47.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.687+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:01:47.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.719+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:01:47.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.747+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:01:47.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.775+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:01:47.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.783+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:01:47.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.799+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:01:47.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.811+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:01:47.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.811+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T15:01:47.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.855+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:01:47.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.867+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:01:47.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.883+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:01:47.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.887+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:01:47.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.899+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:01:47.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.911+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:01:47.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.911+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:01:47.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.943+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:01:47.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.959+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:01:47.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:47.983+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:01:48.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T15:01:48.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.015+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:01:48.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.051+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T15:01:48.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.063+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:01:48.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:01:48.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.071+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:01:48.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.079+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:01:48.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.087+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:01:48.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.107+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:01:48.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.119+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:01:48.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.147+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:01:48.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.167+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:01:48.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.175+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:01:48.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.175+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:01:48.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.187+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:01:48.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.187+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:01:48.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.219+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:01:48.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.223+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:01:48.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.263+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:01:48.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.291+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:01:48.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.295+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T15:01:48.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 290 16 3165649 3165633 682.19 630.5 0.000810269 0.00145578 2024-09-16T15:01:48.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.391+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:01:48.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.423+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:01:48.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.423+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:01:48.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.447+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:01:48.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:01:48.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.463+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:01:48.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.467+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:01:48.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.503+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:01:48.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.511+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:01:48.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.527+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:01:48.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.531+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T15:01:48.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.595+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:01:48.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.619+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:01:48.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.623+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:01:48.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.643+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:01:48.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.651+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:01:48.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.655+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:01:48.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.691+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:01:48.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.703+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T15:01:48.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.715+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:01:48.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.719+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:01:48.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.727+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:01:48.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:01:48.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.743+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:01:48.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.799+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:01:48.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.803+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:48.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.831+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:01:48.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.835+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:01:48.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T15:01:48.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.843+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:01:48.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.871+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:01:48.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.899+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:01:48.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.927+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:01:48.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.931+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:01:48.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.935+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:01:48.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.943+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:01:48.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.943+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:01:48.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.967+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:01:48.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:48.995+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:01:49.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.011+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:01:49.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.015+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:01:49.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.023+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T15:01:49.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.031+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T15:01:49.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.059+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:01:49.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.071+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:01:49.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.115+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:01:49.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.127+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:01:49.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.155+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:01:49.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.163+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:01:49.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.167+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:01:49.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.167+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:01:49.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.179+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:01:49.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.195+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:01:49.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.219+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:01:49.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.247+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:01:49.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.247+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:01:49.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.287+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:01:49.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.291+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:01:49.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.291+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:01:49.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.295+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:01:49.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.299+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:01:49.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.319+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:01:49.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:01:49.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.367+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:01:49.379 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 291 16 3176194 3176178 682.11 659.062 0.000687741 0.0014562 2024-09-16T15:01:49.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.383+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:49.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.391+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:01:49.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.395+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:01:49.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.419+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:01:49.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.423+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:01:49.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.455+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:01:49.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.455+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:01:49.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.467+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:01:49.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.467+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T15:01:49.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.479+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:01:49.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.479+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T15:01:49.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.511+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:01:49.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.523+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:01:49.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.535+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:01:49.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.551+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:01:49.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T15:01:49.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T15:01:49.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.591+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:01:49.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.599+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:49.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.623+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:01:49.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:01:49.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.643+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:01:49.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.667+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T15:01:49.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.675+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:01:49.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.687+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:01:49.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.691+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:01:49.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.691+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:01:49.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.727+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:01:49.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.747+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T15:01:49.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.755+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T15:01:49.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.763+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:01:49.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.763+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:01:49.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.767+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:01:49.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.795+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:269aa95e:::benchmark_data_smithi116_28801_object3471:head, will try copies on 0,4 2024-09-16T15:01:49.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.831+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:01:49.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.839+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:01:49.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.843+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:01:49.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.855+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:01:49.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.855+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:01:49.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.871+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:01:49.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.895+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:49.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.903+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T15:01:49.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.915+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:01:49.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.927+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:01:49.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.931+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c38fa2:::benchmark_data_smithi116_28801_object1501:head, will try copies on 2,3 2024-09-16T15:01:49.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.943+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:01:49.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.971+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:01:49.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.979+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:01:49.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:49.991+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:01:50.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.011+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:01:50.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.011+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:01:50.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.031+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:01:50.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.035+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:01:50.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.071+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:01:50.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.091+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:01:50.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.095+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:01:50.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.111+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:01:50.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.115+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:01:50.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.119+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:01:50.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.127+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T15:01:50.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.131+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b889922b:::benchmark_data_smithi116_28801_object1071:head, will try copies on 2,3 2024-09-16T15:01:50.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.143+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:01:50.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.183+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:01:50.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.187+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:01:50.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.199+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:01:50.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.211+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:01:50.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.219+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:01:50.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.231+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:01:50.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.255+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:01:50.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.283+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:01:50.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.283+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e0b6bc:::benchmark_data_smithi116_28801_object1284:head, will try copies on 2,3 2024-09-16T15:01:50.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.287+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:01:50.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.287+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T15:01:50.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.299+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:01:50.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.315+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:01:50.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.343+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:01:50.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.371+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:01:50.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.375+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:01:50.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 292 16 3187002 3186986 682.087 675.5 0.00158067 0.00145625 2024-09-16T15:01:50.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.387+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:01:50.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.415+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:01:50.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.419+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:01:50.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.419+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:01:50.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.423+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T15:01:50.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.459+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:01:50.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T15:01:50.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.479+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T15:01:50.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.491+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:01:50.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.503+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:01:50.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.535+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:01:50.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.547+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:01:50.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.547+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:01:50.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.551+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:01:50.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.587+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:50.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.595+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:01:50.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.595+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:01:50.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.595+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:01:50.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.639+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T15:01:50.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.651+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b72007:::benchmark_data_smithi116_28801_object3581:head, will try copies on 3,4 2024-09-16T15:01:50.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.655+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:01:50.704 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.699+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:01:50.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:01:50.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.715+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:01:50.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.731+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:01:50.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.755+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:01:50.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.807+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:01:50.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.831+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:01:50.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:01:50.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.843+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:01:50.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.859+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:01:50.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:01:50.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.911+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:01:50.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.939+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:01:50.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.947+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:01:50.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.955+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:01:50.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.987+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:01:50.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.987+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:01:51.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:50.999+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:01:51.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.011+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T15:01:51.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.015+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:01:51.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.035+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:01:51.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.043+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:01:51.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.071+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:01:51.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.079+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:51.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.087+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:01:51.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.107+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:01:51.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.143+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:01:51.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.195+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:01:51.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.195+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:01:51.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.199+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:01:51.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.215+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:01:51.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.255+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:51.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.267+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:01:51.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.271+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:01:51.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.283+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:01:51.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.283+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:01:51.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.287+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:01:51.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.307+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:01:51.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.343+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5942865d:::benchmark_data_smithi116_28801_object695:head, will try copies on 3,4 2024-09-16T15:01:51.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.355+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:01:51.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.371+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:01:51.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 293 16 3198239 3198223 682.156 702.312 0.00098892 0.0014561 2024-09-16T15:01:51.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.411+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:01:51.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.435+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:01:51.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.443+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:01:51.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.443+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:01:51.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.515+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:01:51.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.523+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:01:51.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.531+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:01:51.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.535+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:01:51.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.587+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:01:51.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.615+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:01:51.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.619+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:01:51.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.639+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:01:51.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.655+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:01:51.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.663+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:01:51.674 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.671+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:01:51.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.679+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:01:51.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.687+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T15:01:51.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.703+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:01:51.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.719+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:01:51.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.723+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:01:51.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.739+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:01:51.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.747+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:01:51.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.771+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:01:51.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.779+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:01:51.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.815+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:01:51.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.823+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T15:01:51.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.831+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T15:01:51.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.831+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:01:51.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.867+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:01:51.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.867+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:01:51.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.879+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:01:51.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.903+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:01:51.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.903+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:01:51.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.911+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:01:51.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.919+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:01:51.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.955+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:01:51.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.971+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:01:51.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:51.987+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:52.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.023+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:01:52.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.035+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:01:52.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.035+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:01:52.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.043+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:01:52.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.075+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T15:01:52.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.095+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:01:52.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.107+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:01:52.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.115+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:01:52.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.123+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:01:52.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.127+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:01:52.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.159+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:01:52.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.179+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:01:52.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.179+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:01:52.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.195+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:52.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.203+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:01:52.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.207+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T15:01:52.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.211+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:01:52.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.227+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T15:01:52.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.267+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:01:52.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.279+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:01:52.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.315+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:01:52.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.315+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:01:52.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.347+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:01:52.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.351+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:01:52.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.371+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:52.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 294 16 3209434 3209418 682.216 699.688 0.000675386 0.00145596 2024-09-16T15:01:52.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.395+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T15:01:52.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.403+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:01:52.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.439+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:01:52.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.443+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:01:52.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.471+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:52.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.471+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:01:52.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.475+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:01:52.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.479+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:01:52.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.507+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:01:52.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.523+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:01:52.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.539+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:01:52.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.539+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:01:52.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.543+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:01:52.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.543+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:52.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.591+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:01:52.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.607+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:01:52.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.615+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:01:52.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.623+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:52.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.627+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:01:52.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.639+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:01:52.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.651+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:01:52.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.703+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:01:52.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.707+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:01:52.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.735+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:01:52.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.739+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:01:52.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.743+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:01:52.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.747+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:01:52.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.771+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:01:52.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.791+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:52.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.811+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:52.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.819+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:01:52.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.823+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:01:52.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.835+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:01:52.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.851+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:01:52.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.887+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:01:52.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.891+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:01:52.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.903+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:01:52.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.907+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:01:52.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.935+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:01:52.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.943+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:52.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.951+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:01:52.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.955+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:01:52.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:52.995+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:01:53.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.003+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T15:01:53.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.015+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:01:53.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.055+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0f9d780:::benchmark_data_smithi116_28801_object207:head, will try copies on 2,3 2024-09-16T15:01:53.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.071+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T15:01:53.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.087+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:01:53.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.091+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:01:53.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.091+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:01:53.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:01:53.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.115+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T15:01:53.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.163+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:01:53.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:01:53.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.187+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:01:53.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.195+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:01:53.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.199+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:01:53.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:01:53.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.215+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:01:53.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:01:53.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.259+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:01:53.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.279+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T15:01:53.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.295+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T15:01:53.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.311+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:01:53.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.311+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:01:53.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.319+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:01:53.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.323+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:01:53.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.347+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:01:53.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.371+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:01:53.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 295 16 3220631 3220615 682.275 699.812 0.000742601 0.00145584 2024-09-16T15:01:53.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.383+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:01:53.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.399+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T15:01:53.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.419+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:01:53.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:01:53.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.451+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:01:53.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.491+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:01:53.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.519+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:01:53.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.559+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:01:53.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.571+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:01:53.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.571+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:01:53.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.571+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5cadc7d:::benchmark_data_smithi116_28801_object884:head, will try copies on 2,3 2024-09-16T15:01:53.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.619+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:01:53.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.619+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:01:53.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.643+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:01:53.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.659+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:01:53.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.659+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:01:53.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.663+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:01:53.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.675+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:01:53.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.679+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:01:53.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.727+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:01:53.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.747+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:01:53.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.755+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:01:53.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.755+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:01:53.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.755+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25b51d7:::benchmark_data_smithi116_28801_object1033:head, will try copies on 2,3 2024-09-16T15:01:53.764 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.759+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:01:53.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.771+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:01:53.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.787+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:01:53.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.815+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:01:53.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.831+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:01:53.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.855+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:01:53.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.879+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T15:01:53.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.899+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:01:53.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.915+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:01:53.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.927+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:01:53.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.935+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:01:53.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.951+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:01:53.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.967+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:01:53.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.971+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692f1b49:::benchmark_data_smithi116_28801_object3545:head, will try copies on 3,4 2024-09-16T15:01:53.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.979+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:01:53.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:53.991+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:01:54.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.019+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:01:54.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.019+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:01:54.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.039+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:01:54.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.047+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T15:01:54.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.083+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:01:54.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.091+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:54.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.095+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:01:54.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.099+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:01:54.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.123+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:01:54.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.151+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:01:54.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.163+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:01:54.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.183+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T15:01:54.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.191+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:01:54.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.195+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:01:54.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.247+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:01:54.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.251+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:01:54.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.267+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:01:54.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.271+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T15:01:54.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.291+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:01:54.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:01:54.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.331+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:01:54.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.359+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:01:54.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:01:54.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 296 16 3232023 3232007 682.375 712 0.000657232 0.00145562 2024-09-16T15:01:54.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:01:54.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.399+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:01:54.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.423+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:01:54.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.447+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:01:54.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.455+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:01:54.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.475+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:01:54.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.495+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:01:54.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.499+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:01:54.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.519+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:01:54.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.535+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:01:54.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.555+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:01:54.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.571+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:01:54.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.571+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:01:54.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.575+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:01:54.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.579+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:01:54.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.595+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:54.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.603+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T15:01:54.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.651+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:01:54.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.655+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:01:54.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.687+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:01:54.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.695+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:01:54.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.703+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:01:54.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.719+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:01:54.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.731+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:01:54.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.751+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:01:54.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.763+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:01:54.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.779+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:01:54.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.779+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:01:54.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.811+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:01:54.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.827+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:01:54.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.831+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:01:54.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.839+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T15:01:54.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.847+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:01:54.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.863+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:01:54.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.871+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:01:54.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.883+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:01:54.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.903+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T15:01:54.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.915+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:01:54.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.927+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:01:54.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.931+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:01:54.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.939+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:01:54.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.955+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:01:54.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.991+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:01:54.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:54.991+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:01:55.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:01:55.019 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.015+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:01:55.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.027+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:01:55.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.039+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:01:55.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.047+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:01:55.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.051+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e89037:::benchmark_data_smithi116_28801_object3269:head, will try copies on 2,3 2024-09-16T15:01:55.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.055+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:01:55.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.067+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:01:55.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.071+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:01:55.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.111+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:01:55.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.123+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:01:55.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.123+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:01:55.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.147+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T15:01:55.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.155+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:01:55.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.163+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:01:55.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.171+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:01:55.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.187+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:01:55.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.203+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:01:55.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.247+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:01:55.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:01:55.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.255+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:01:55.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:01:55.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.275+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:01:55.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.291+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:01:55.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.299+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:01:55.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.339+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:01:55.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.351+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:55.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.351+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:55.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.371+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:01:55.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 297 16 3242880 3242864 682.362 678.562 0.00274016 0.00145566 2024-09-16T15:01:55.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.411+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:01:55.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.419+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:01:55.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:01:55.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.431+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:01:55.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.447+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:01:55.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.471+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T15:01:55.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.483+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:01:55.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.483+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:01:55.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.499+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:01:55.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.503+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:01:55.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.527+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:01:55.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.531+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:01:55.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.535+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:01:55.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.579+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T15:01:55.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.587+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:01:55.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.591+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:01:55.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.623+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:01:55.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.631+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:01:55.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.643+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:01:55.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.651+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:01:55.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.655+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T15:01:55.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.663+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T15:01:55.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.687+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:01:55.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.687+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:01:55.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.699+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:01:55.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.707+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:01:55.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.731+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:01:55.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:01:55.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.755+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:01:55.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.775+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:01:55.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.787+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:01:55.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.811+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:01:55.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.823+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:01:55.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:55.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.831+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6537c054:::benchmark_data_smithi116_28801_object3982:head, will try copies on 3,4 2024-09-16T15:01:55.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:01:55.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.843+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:01:55.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.867+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T15:01:55.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.879+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:01:55.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.899+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T15:01:55.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.903+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:01:55.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.911+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:01:55.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.911+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:01:55.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.939+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:01:55.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:55.955+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:01:56.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.003+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T15:01:56.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.003+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:01:56.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.023+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:01:56.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.035+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:01:56.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.039+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:01:56.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.059+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:01:56.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.075+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:01:56.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.091+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8fbf0e:::benchmark_data_smithi116_28801_object605:head, will try copies on 3,4 2024-09-16T15:01:56.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.099+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:01:56.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.111+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:01:56.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.119+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:01:56.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.119+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:01:56.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.131+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:01:56.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.139+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:01:56.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:01:56.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.175+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:01:56.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.179+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:01:56.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.219+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T15:01:56.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:01:56.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.247+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:01:56.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.247+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:01:56.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.275+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:01:56.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.279+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:01:56.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.291+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:01:56.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.315+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:01:56.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.319+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:01:56.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.335+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:01:56.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.355+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:01:56.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.355+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:01:56.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.367+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:01:56.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.375+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242b1633:::benchmark_data_smithi116_28801_object1341:head, will try copies on 0,4 2024-09-16T15:01:56.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 298 15 3253560 3253545 682.313 667.562 0.000927203 0.00145575 2024-09-16T15:01:56.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.415+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:01:56.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.419+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:01:56.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.427+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:01:56.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.447+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:01:56.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.463+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:01:56.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.483+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:01:56.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.491+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:01:56.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.507+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:01:56.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.515+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:01:56.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.555+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:01:56.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.595+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:01:56.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.599+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:01:56.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.603+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T15:01:56.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.607+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:01:56.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.639+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:01:56.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.671+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:01:56.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.675+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:01:56.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.683+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:01:56.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.695+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:01:56.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.695+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:01:56.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.731+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51635d61:::benchmark_data_smithi116_28801_object2651:head, will try copies on 3,4 2024-09-16T15:01:56.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.759+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:01:56.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.775+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:01:56.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.783+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:01:56.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.803+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T15:01:56.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.827+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:01:56.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.827+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa5e706:::benchmark_data_smithi116_28801_object1192:head, will try copies on 0,4 2024-09-16T15:01:56.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.863+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:01:56.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.863+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:01:56.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.875+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:01:56.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.887+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:01:56.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.887+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:01:56.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.975+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:01:56.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.983+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:01:56.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.987+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:01:57.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:56.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:01:57.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.015+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:01:57.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.019+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:01:57.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:01:57.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.063+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9510a3f8:::benchmark_data_smithi116_28801_object4050:head, will try copies on 0,4 2024-09-16T15:01:57.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.067+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:01:57.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.071+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:01:57.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.119+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:01:57.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:01:57.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.143+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T15:01:57.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.159+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T15:01:57.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.171+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:01:57.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.175+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:01:57.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.179+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:01:57.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.195+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:01:57.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.219+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:01:57.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.231+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:01:57.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.243+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:01:57.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.251+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:01:57.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.275+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:01:57.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.291+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:01:57.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.295+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:01:57.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.299+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:01:57.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.311+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:01:57.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.327+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T15:01:57.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.347+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:01:57.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.351+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:01:57.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.355+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:01:57.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 299 16 3264340 3264324 682.284 673.688 0.000750082 0.00145582 2024-09-16T15:01:57.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.375+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:01:57.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.407+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:01:57.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.411+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:01:57.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.435+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:01:57.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.451+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:01:57.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.471+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:01:57.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.491+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:01:57.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.511+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:01:57.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.519+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:01:57.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.531+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:01:57.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.539+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:01:57.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.543+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:01:57.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.575+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:01:57.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.579+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:01:57.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.583+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:01:57.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.599+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:01:57.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.623+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:01:57.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.651+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:01:57.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.659+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:01:57.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.663+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:01:57.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.667+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:57.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T15:01:57.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.691+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:01:57.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.707+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:01:57.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.723+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:01:57.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.743+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:01:57.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.747+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:01:57.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.747+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:01:57.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.751+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:01:57.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.755+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:01:57.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.767+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:01:57.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.779+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:01:57.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.791+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:01:57.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.803+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:01:57.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.835+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:01:57.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.839+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:01:57.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.839+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:01:57.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.875+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:01:57.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.879+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:01:57.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.883+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:01:57.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.887+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:01:57.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.899+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:01:57.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.911+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:01:57.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.919+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:01:57.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.931+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:01:57.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.951+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:01:58.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.995+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T15:01:58.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:57.999+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:01:58.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.007+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:01:58.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:01:58.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.027+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:01:58.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.031+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:01:58.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.047+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:01:58.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.055+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:01:58.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.075+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:01:58.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.079+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:01:58.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.083+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:01:58.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.111+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:01:58.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.123+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:01:58.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.127+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:01:58.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.151+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:01:58.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.155+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:01:58.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.163+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:01:58.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.179+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:01:58.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.195+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:01:58.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.195+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:01:58.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.199+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:01:58.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.203+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:01:58.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.231+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:58.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.235+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:01:58.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.243+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:01:58.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.259+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:01:58.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.291+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:01:58.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.299+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:01:58.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.343+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:01:58.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.343+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:01:58.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.371+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9843dae3:::benchmark_data_smithi116_28801_object933:head, will try copies on 0,4 2024-09-16T15:01:58.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:01:58.381238+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.00145589 2024-09-16T15:01:58.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:01:58.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 300 16 3275103 3275087 682.251 672.688 0.000974584 0.00145589 2024-09-16T15:01:58.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.379+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T15:01:58.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.407+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:01:58.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.411+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:01:58.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.435+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:01:58.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.447+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T15:01:58.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.459+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:01:58.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.475+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:01:58.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.483+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:01:58.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.543+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:01:58.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.555+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:01:58.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.563+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:01:58.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.595+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:01:58.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.623+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T15:01:58.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.639+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:01:58.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.655+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:01:58.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.663+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T15:01:58.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.663+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:01:58.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.675+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:01:58.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.683+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T15:01:58.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.683+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:01:58.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.699+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:01:58.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.711+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:01:58.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.739+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T15:01:58.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.739+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:01:58.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.783+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:01:58.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.807+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:01:58.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.819+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:01:58.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.827+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T15:01:58.834 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.831+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:01:58.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:01:58.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.859+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:01:58.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.875+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:01:58.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.883+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:01:58.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.919+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:01:58.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.947+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:01:58.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.947+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:01:58.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.951+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:01:58.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.967+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:01:59.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.995+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:01:59.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:58.995+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:01:59.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.003+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:01:59.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.055+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:01:59.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:01:59.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.071+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:01:59.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.087+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:01:59.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.119+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:01:59.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.143+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:01:59.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.171+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:01:59.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.175+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:01:59.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.179+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:01:59.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.199+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:01:59.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.207+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:01:59.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:01:59.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.247+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:01:59.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.275+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:01:59.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.283+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93bc25e9:::benchmark_data_smithi116_28801_object2050:head, will try copies on 0,4 2024-09-16T15:01:59.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.283+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T15:01:59.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.315+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:01:59.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.323+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:01:59.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.331+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:01:59.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.331+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T15:01:59.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.335+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T15:01:59.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.351+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:01:59.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.367+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:01:59.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 301 15 3286559 3286544 682.363 716.062 0.000903108 0.00145561 2024-09-16T15:01:59.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.403+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:01:59.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.423+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:01:59.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.427+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:01:59.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.427+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:01:59.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.443+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:01:59.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.443+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T15:01:59.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.459+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T15:01:59.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.471+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:01:59.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.507+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:01:59.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.507+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:01:59.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.547+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:01:59.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.555+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:01:59.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.575+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:01:59.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.603+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:01:59.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T15:01:59.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.635+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:01:59.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.659+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:01:59.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.675+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:01:59.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:01:59.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.703+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:01:59.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.703+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:01:59.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.711+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:01:59.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.727+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:01:59.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:01:59.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.743+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:01:59.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.783+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:01:59.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.787+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:01:59.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.791+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:01:59.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.807+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:01:59.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.807+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:01:59.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:01:59.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.847+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:01:59.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.847+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:01:59.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.879+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:01:59.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.903+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:01:59.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.923+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:01:59.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.923+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:01:59.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.935+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:01:59.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.939+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:01:59.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.971+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:01:59.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.979+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:02:00.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:01:59.999+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T15:02:00.007 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.003+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:02:00.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.027+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:02:00.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.035+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:02:00.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.083+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:02:00.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.095+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:00.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.103+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:02:00.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.115+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:02:00.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.135+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:02:00.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:02:00.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.143+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:02:00.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.155+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:02:00.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.155+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:02:00.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.187+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:02:00.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.203+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:02:00.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.211+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:02:00.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.223+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:02:00.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.231+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:02:00.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:00.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.283+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:02:00.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.315+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:02:00.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.315+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:02:00.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.319+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:02:00.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:02:00.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.351+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:02:00.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.363+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:02:00.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.371+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:02:00.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.371+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:02:00.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 302 16 3297691 3297675 682.407 695.688 0.00224454 0.00145555 2024-09-16T15:02:00.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.419+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:02:00.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.427+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:02:00.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.435+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T15:02:00.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.451+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:02:00.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.487+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:02:00.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.487+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:02:00.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.491+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:02:00.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.507+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:02:00.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.535+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:02:00.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.559+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:02:00.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.575+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T15:02:00.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.575+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:02:00.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.579+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:02:00.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.591+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T15:02:00.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.599+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:02:00.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.611+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:02:00.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.619+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:02:00.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.623+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:02:00.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.659+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T15:02:00.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.679+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b617ae9:::benchmark_data_smithi116_28801_object3996:head, will try copies on 3,4 2024-09-16T15:02:00.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.687+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5593e123:::benchmark_data_smithi116_28801_object1872:head, will try copies on 3,4 2024-09-16T15:02:00.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.695+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:02:00.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.719+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T15:02:00.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.723+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:02:00.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.731+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:00.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.747+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:02:00.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.755+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:02:00.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:02:00.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.807+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:02:00.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.811+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:02:00.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.823+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:02:00.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.831+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:02:00.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.839+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:02:00.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.875+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:02:00.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.875+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:02:00.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.891+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:02:00.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:02:00.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.907+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:00.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.911+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:02:00.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.923+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:02:00.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.931+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:02:00.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.951+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:02:00.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:00.983+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:02:01.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.015+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:02:01.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.031+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:02:01.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.035+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:02:01.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.063+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:02:01.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.075+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:02:01.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.103+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:02:01.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.115+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:02:01.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.115+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:02:01.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.123+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T15:02:01.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.131+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:02:01.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.151+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:02:01.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.171+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d905c7e:::benchmark_data_smithi116_28801_object666:head, will try copies on 0,4 2024-09-16T15:02:01.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.175+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:01.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.227+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:02:01.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.243+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:02:01.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.243+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:02:01.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.251+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T15:02:01.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.255+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:02:01.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.263+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:02:01.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.279+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d5e556:::benchmark_data_smithi116_28801_object2382:head, will try copies on 3,4 2024-09-16T15:02:01.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.291+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:02:01.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.295+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:02:01.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.307+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:02:01.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.335+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:01.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.339+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:02:01.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.363+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:02:01.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 303 15 3308864 3308849 682.46 698.375 0.000759973 0.00145545 2024-09-16T15:02:01.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.379+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:02:01.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.403+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:02:01.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.403+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:01.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.423+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:01.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.439+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:02:01.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.455+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:02:01.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.463+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T15:02:01.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.467+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:02:01.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.475+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:02:01.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.479+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:02:01.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.499+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T15:02:01.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.547+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:02:01.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.579+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:02:01.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.611+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:02:01.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.615+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:02:01.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.627+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:02:01.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.639+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:02:01.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.643+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:02:01.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.667+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:02:01.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.667+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:02:01.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.675+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:02:01.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.691+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:01.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.703+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:02:01.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.715+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:02:01.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.755+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T15:02:01.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.755+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:02:01.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.755+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:02:01.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.771+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:02:01.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.795+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:02:01.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.803+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:02:01.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.803+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T15:02:01.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.823+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:02:01.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:02:01.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.835+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:02:01.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.843+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25cd7881:::benchmark_data_smithi116_28801_object3455:head, will try copies on 0,4 2024-09-16T15:02:01.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.875+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:02:01.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.887+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:02:01.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.899+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:02:01.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.903+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:02:01.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.919+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:01.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.927+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T15:02:01.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.951+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:02:01.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.959+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:02:01.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.963+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:02:01.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.995+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:02:02.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:01.999+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:02:02.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.007+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:02:02.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.011+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:02:02.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.035+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:02:02.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.047+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:02:02.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.071+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:02.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.083+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:02:02.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.095+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:02:02.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.099+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:02.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.119+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:02.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.139+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:02:02.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.147+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:02:02.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.159+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:02.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.175+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:02:02.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.183+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:02:02.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.195+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950bf944:::benchmark_data_smithi116_28801_object459:head, will try copies on 0,4 2024-09-16T15:02:02.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.211+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:02:02.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T15:02:02.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.235+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:02:02.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.259+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:02:02.274 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.271+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:02:02.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.311+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:02:02.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.323+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T15:02:02.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.323+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:02.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.331+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:02:02.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.359+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:02:02.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.359+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:02:02.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 304 16 3319493 3319477 682.4 664.25 0.00515872 0.00145555 2024-09-16T15:02:02.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.375+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:02:02.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.391+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:02.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.399+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:02:02.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.411+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:02:02.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.423+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:02:02.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.455+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:02:02.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.455+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:02:02.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.475+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:02:02.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.491+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:02:02.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.491+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:02:02.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:02:02.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.519+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T15:02:02.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.527+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:02:02.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.543+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:02:02.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.555+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:02:02.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.595+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:02:02.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.607+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:02:02.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.615+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:02:02.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.659+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:02:02.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.659+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:02:02.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:02:02.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.695+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:02:02.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.707+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:02:02.722 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.719+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:02:02.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.727+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:02:02.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.751+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed81665:::benchmark_data_smithi116_28801_object3313:head, will try copies on 3,4 2024-09-16T15:02:02.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.751+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:02:02.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:02:02.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.791+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:02.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.807+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:02:02.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.819+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:02.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.831+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:02:02.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.847+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:02:02.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.851+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:02.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.887+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:02:02.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:02:02.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.899+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:02:02.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:02:02.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.927+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:02:02.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.935+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:02:02.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.967+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:02.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.971+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:02:02.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.971+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:02:03.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:02.999+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:02:03.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.003+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:02:03.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.027+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:02:03.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.031+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:03.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.035+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d98e1e0:::benchmark_data_smithi116_28801_object3377:head, will try copies on 3,4 2024-09-16T15:02:03.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.055+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T15:02:03.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.067+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:02:03.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.091+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:02:03.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.091+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:02:03.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.123+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:02:03.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.131+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:02:03.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.151+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:02:03.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.183+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a46519:::benchmark_data_smithi116_28801_object1991:head, will try copies on 0,4 2024-09-16T15:02:03.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.191+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:02:03.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.211+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:03.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.215+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:02:03.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.243+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:02:03.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.263+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:02:03.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.271+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:02:03.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.271+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:02:03.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.283+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:02:03.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.287+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:03.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.299+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:02:03.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.327+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:02:03.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.363+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50074087:::benchmark_data_smithi116_28801_object1537:head, will try copies on 3,4 2024-09-16T15:02:03.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.367+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:02:03.380 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 305 15 3330212 3330197 682.359 670 0.000973377 0.00145566 2024-09-16T15:02:03.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:02:03.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.399+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:02:03.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.423+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:02:03.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.423+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:02:03.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.459+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:02:03.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.459+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:02:03.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.479+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:03.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.507+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:02:03.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.507+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:02:03.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.535+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:02:03.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.539+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:02:03.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.543+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:02:03.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.567+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:02:03.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.571+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:02:03.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.595+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:02:03.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.607+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:02:03.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.607+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:02:03.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.615+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T15:02:03.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.631+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ecc4b:::benchmark_data_smithi116_28801_object1238:head, will try copies on 3,4 2024-09-16T15:02:03.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.651+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:02:03.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:02:03.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.687+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:02:03.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.703+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:02:03.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.707+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:02:03.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.715+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:03.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.719+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T15:02:03.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.735+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:02:03.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.755+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159a0d:::benchmark_data_smithi116_28801_object3244:head, will try copies on 3,4 2024-09-16T15:02:03.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.771+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:02:03.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.807+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:02:03.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.811+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T15:02:03.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:02:03.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.835+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T15:02:03.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.847+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:02:03.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.855+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:02:03.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.871+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:02:03.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.903+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:02:03.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.911+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:02:03.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.919+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:02:03.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.979+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:02:03.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:03.987+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:02:04.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:02:04.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.015+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T15:02:04.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.019+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:04.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.039+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:02:04.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.039+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:02:04.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.047+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:02:04.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.091+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T15:02:04.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.107+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:02:04.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.115+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T15:02:04.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.119+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:02:04.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.143+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:02:04.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.159+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:02:04.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.163+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:02:04.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.167+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:02:04.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.195+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:02:04.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.199+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:02:04.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.203+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:02:04.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.219+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:02:04.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:02:04.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.251+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T15:02:04.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.271+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:02:04.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.283+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:02:04.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.299+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:02:04.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:02:04.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.315+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:02:04.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.351+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:02:04.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.355+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:04.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.355+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T15:02:04.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 306 16 3341575 3341559 682.45 710.125 0.00077777 0.00145546 2024-09-16T15:02:04.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.391+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:02:04.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.411+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc84acc:::benchmark_data_smithi116_28801_object3609:head, will try copies on 3,4 2024-09-16T15:02:04.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.427+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:02:04.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.443+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:02:04.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.447+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:02:04.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.451+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:02:04.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.471+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:02:04.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.471+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:04.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.495+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:02:04.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.511+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:02:04.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.511+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:04.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.519+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:02:04.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.523+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:02:04.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.559+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:04.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.587+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:02:04.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.591+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:02:04.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.595+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T15:02:04.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.599+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T15:02:04.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.611+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:02:04.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.643+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:02:04.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.643+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:02:04.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.663+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:02:04.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.679+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:02:04.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.683+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:02:04.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.691+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:02:04.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.699+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:02:04.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.739+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:02:04.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.755+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:04.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.779+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:02:04.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.787+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:02:04.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.807+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab51cdc:::benchmark_data_smithi116_28801_object1953:head, will try copies on 2,3 2024-09-16T15:02:04.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.811+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:02:04.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.823+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:02:04.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.827+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:02:04.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.835+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:02:04.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.875+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:02:04.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.883+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:02:04.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.911+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:04.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.927+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:02:04.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.955+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:02:04.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.967+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T15:02:04.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.975+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:02:05.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:04.999+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:02:05.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.003+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:02:05.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:02:05.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.015+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:02:05.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.039+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:02:05.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.063+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:02:05.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.095+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:02:05.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.099+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:02:05.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.103+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:02:05.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.111+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:02:05.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.119+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:05.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.123+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee5b70e:::benchmark_data_smithi116_28801_object3174:head, will try copies on 0,4 2024-09-16T15:02:05.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.139+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:02:05.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.147+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:02:05.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:02:05.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.187+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:02:05.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.187+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:02:05.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.195+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:05.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.215+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T15:02:05.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.227+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:02:05.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.239+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:02:05.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.275+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:02:05.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.279+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:02:05.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.283+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:02:05.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.319+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T15:02:05.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.323+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:02:05.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.335+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:05.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.355+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:02:05.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.355+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:02:05.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.359+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:02:05.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 307 16 3352475 3352459 682.445 681.25 0.000680447 0.00145546 2024-09-16T15:02:05.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.399+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:02:05.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.415+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:02:05.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.415+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T15:02:05.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.427+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a327f:::benchmark_data_smithi116_28801_object1226:head, will try copies on 3,4 2024-09-16T15:02:05.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.447+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:02:05.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.455+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:02:05.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.459+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:05.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.463+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:02:05.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.467+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:02:05.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.479+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:02:05.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.499+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:02:05.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.503+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:02:05.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.535+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:02:05.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.535+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2802b1c:::benchmark_data_smithi116_28801_object3132:head, will try copies on 2,3 2024-09-16T15:02:05.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.543+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:02:05.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.551+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:02:05.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.555+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T15:02:05.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.575+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:02:05.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.595+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:05.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.603+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:02:05.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.611+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:02:05.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.619+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:02:05.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.631+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:02:05.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.663+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:02:05.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.667+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:02:05.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.671+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T15:02:05.695 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.691+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:05.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.695+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:02:05.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.723+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:02:05.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.731+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T15:02:05.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.751+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T15:02:05.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.755+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b514c10:::benchmark_data_smithi116_28801_object637:head, will try copies on 0,4 2024-09-16T15:02:05.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.783+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:05.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.791+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:02:05.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.803+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:02:05.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.803+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T15:02:05.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.815+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:02:05.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:02:05.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.851+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652b147f:::benchmark_data_smithi116_28801_object3831:head, will try copies on 3,4 2024-09-16T15:02:05.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.871+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:02:05.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.875+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:02:05.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.895+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:02:05.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:02:05.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.927+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:05.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.971+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:02:05.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.979+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:02:05.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:05.991+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:02:06.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.015+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:02:06.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.027+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:06.053 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.047+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:06.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.055+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:06.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.063+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:02:06.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.067+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:02:06.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.095+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:02:06.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.111+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:02:06.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.127+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6afdb04:::benchmark_data_smithi116_28801_object2231:head, will try copies on 2,3 2024-09-16T15:02:06.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.131+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:02:06.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.139+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:02:06.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.167+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:02:06.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.171+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:02:06.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.179+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T15:02:06.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.183+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:02:06.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.215+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:02:06.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.235+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:02:06.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.243+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:02:06.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.251+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:06.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.259+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51bbdac8:::benchmark_data_smithi116_28801_object1249:head, will try copies on 3,4 2024-09-16T15:02:06.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.263+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:02:06.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.267+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:02:06.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.291+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:02:06.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.299+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:02:06.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.339+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:06.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.343+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6ec335:::benchmark_data_smithi116_28801_object2884:head, will try copies on 3,4 2024-09-16T15:02:06.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.347+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:02:06.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.359+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:02:06.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.371+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:02:06.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 308 16 3363166 3363150 682.399 668.188 0.00272495 0.00145557 2024-09-16T15:02:06.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.391+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T15:02:06.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.399+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:02:06.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.411+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T15:02:06.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.423+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:06.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.423+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:02:06.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.427+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:06.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.439+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:02:06.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.443+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T15:02:06.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.451+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:02:06.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.471+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:02:06.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.519+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:02:06.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.527+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:02:06.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.547+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:02:06.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.563+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a699562:::benchmark_data_smithi116_28801_object3627:head, will try copies on 0,4 2024-09-16T15:02:06.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.567+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:02:06.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.575+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:02:06.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.579+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T15:02:06.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.603+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T15:02:06.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.611+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T15:02:06.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:06.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.643+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T15:02:06.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.671+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T15:02:06.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.679+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T15:02:06.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.703+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:02:06.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.719+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:02:06.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.747+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:02:06.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.747+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:06.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.763+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:02:06.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.775+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:02:06.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.803+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:02:06.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.803+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:06.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.819+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:02:06.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.839+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:02:06.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.863+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:02:06.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.871+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:02:06.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.875+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:02:06.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.883+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:02:06.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.903+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc389960:::benchmark_data_smithi116_28801_object3420:head, will try copies on 2,3 2024-09-16T15:02:06.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.907+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T15:02:06.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.955+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:02:06.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.975+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:02:06.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.983+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T15:02:06.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:06.983+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:02:07.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.011+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:02:07.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.019+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:02:07.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.039+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:02:07.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.055+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:02:07.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.075+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:07.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:02:07.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.099+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T15:02:07.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.111+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:02:07.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.127+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:02:07.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.151+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:02:07.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.163+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:02:07.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.167+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b022c8d8:::benchmark_data_smithi116_28801_object3105:head, will try copies on 2,3 2024-09-16T15:02:07.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.183+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:02:07.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.203+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:02:07.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.211+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:02:07.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.219+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:02:07.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.239+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:02:07.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.247+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T15:02:07.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.255+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:07.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.283+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:02:07.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 309 16 3373594 3373578 682.299 651.75 0.000583885 0.00145548 2024-09-16T15:02:07.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.399+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:02:07.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.451+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:02:07.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.467+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:02:07.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.467+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:02:07.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.499+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baef923a:::benchmark_data_smithi116_28801_object1617:head, will try copies on 2,3 2024-09-16T15:02:07.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.535+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:07.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.539+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:02:07.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.551+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:02:07.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.559+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:02:07.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.567+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:02:07.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.607+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:02:07.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.611+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T15:02:07.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.619+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:02:07.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.627+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:02:07.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.643+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:02:07.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.659+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:02:07.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.663+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:02:07.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.747+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:02:07.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.755+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:02:07.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.755+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:02:07.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.755+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:02:07.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.775+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:02:07.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.779+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:02:07.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.815+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:02:07.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.827+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:02:07.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.871+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:07.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.887+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:02:07.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.887+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:02:07.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.907+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:02:07.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.927+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:02:07.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.939+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:02:07.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.951+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:02:07.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.983+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:02:07.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:07.991+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:02:08.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.015+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25668ea4:::benchmark_data_smithi116_28801_object1384:head, will try copies on 0,4 2024-09-16T15:02:08.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.023+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6980a906:::benchmark_data_smithi116_28801_object2340:head, will try copies on 3,4 2024-09-16T15:02:08.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.047+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:02:08.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.075+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:02:08.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.091+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:02:08.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.123+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:02:08.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.143+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:02:08.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.143+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:02:08.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.147+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:02:08.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.159+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:02:08.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.167+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:02:08.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.211+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:02:08.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.231+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:02:08.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.235+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:02:08.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.243+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T15:02:08.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.255+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:02:08.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.267+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T15:02:08.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.279+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:02:08.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.291+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:02:08.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.311+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T15:02:08.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.315+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:02:08.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.323+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:02:08.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.331+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:02:08.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.371+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:02:08.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 310 15 3383966 3383951 682.19 648.312 0.000943531 0.00145603 2024-09-16T15:02:08.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.383+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:02:08.391 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.387+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:02:08.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.391+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:02:08.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.415+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:02:08.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.435+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:02:08.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.463+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:02:08.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.483+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235d688e:::benchmark_data_smithi116_28801_object3668:head, will try copies on 0,4 2024-09-16T15:02:08.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.487+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T15:02:08.506 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.503+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:02:08.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.535+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:02:08.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.547+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:02:08.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.555+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:02:08.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.555+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:02:08.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.567+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:02:08.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.571+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:02:08.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.595+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:02:08.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.607+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:02:08.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.639+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bd460b3:::benchmark_data_smithi116_28801_object3832:head, will try copies on 0,4 2024-09-16T15:02:08.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.639+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:02:08.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.643+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:02:08.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.643+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:02:08.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.671+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:02:08.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.695+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5404f72:::benchmark_data_smithi116_28801_object4108:head, will try copies on 2,3 2024-09-16T15:02:08.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.743+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:02:08.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.791+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:02:08.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.791+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:02:08.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.819+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:02:08.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.839+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T15:02:08.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.839+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:02:08.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.847+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:02:08.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.851+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:02:08.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.871+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:08.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.883+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2e306e:::benchmark_data_smithi116_28801_object4048:head, will try copies on 0,4 2024-09-16T15:02:08.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.899+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:02:08.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.915+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:02:08.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.923+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:02:08.941 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.935+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:02:08.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.947+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:02:08.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.975+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:02:09.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:08.995+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:02:09.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.031+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:02:09.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.035+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:02:09.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:02:09.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.055+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:09.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.059+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:02:09.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.107+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T15:02:09.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.107+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T15:02:09.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.111+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:02:09.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.115+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:02:09.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.139+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:02:09.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.167+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:02:09.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.171+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:02:09.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.183+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ff6d92:::benchmark_data_smithi116_28801_object1161:head, will try copies on 3,4 2024-09-16T15:02:09.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.187+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:02:09.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.199+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:02:09.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.231+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T15:02:09.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.263+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:02:09.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.263+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:02:09.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.271+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:02:09.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.275+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f569c8c:::benchmark_data_smithi116_28801_object467:head, will try copies on 0,4 2024-09-16T15:02:09.302 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.299+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:02:09.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.319+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:02:09.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.327+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:02:09.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.351+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:02:09.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.363+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T15:02:09.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 311 16 3394945 3394929 682.202 686.125 0.00148299 0.001456 2024-09-16T15:02:09.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.379+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T15:02:09.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.399+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:02:09.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.399+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:02:09.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.415+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:02:09.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.427+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:09.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.427+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:02:09.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.483+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:02:09.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.503+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:02:09.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.515+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:02:09.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.519+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:02:09.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.523+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:02:09.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.551+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506b5411:::benchmark_data_smithi116_28801_object2904:head, will try copies on 3,4 2024-09-16T15:02:09.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.563+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:02:09.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.583+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T15:02:09.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.591+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:02:09.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.595+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:02:09.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.623+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:02:09.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.623+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:09.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.663+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:02:09.682 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.679+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:02:09.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.683+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:02:09.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.683+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:02:09.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.711+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:02:09.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.715+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6192633:::benchmark_data_smithi116_28801_object874:head, will try copies on 2,3 2024-09-16T15:02:09.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.743+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:02:09.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.747+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:02:09.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.763+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:02:09.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.771+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:02:09.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.787+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:02:09.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.795+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T15:02:09.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.799+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:02:09.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.831+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:02:09.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.839+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:02:09.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.839+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:02:09.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.855+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:02:09.865 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.863+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:02:09.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.879+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:02:09.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.915+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:02:09.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:02:09.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.923+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:02:09.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.935+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:02:09.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.947+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a48f12e:::benchmark_data_smithi116_28801_object2487:head, will try copies on 0,4 2024-09-16T15:02:09.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.947+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T15:02:09.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.963+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:02:09.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:09.979+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T15:02:10.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.003+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:02:10.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.023+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:02:10.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.027+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:02:10.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.035+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:02:10.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.039+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:02:10.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.055+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:02:10.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.063+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:02:10.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.067+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:02:10.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.091+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:02:10.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.091+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:02:10.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.123+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:02:10.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.123+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:02:10.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.147+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:02:10.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.147+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:02:10.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.163+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:02:10.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.171+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:02:10.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.199+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:651f6872:::benchmark_data_smithi116_28801_object2368:head, will try copies on 3,4 2024-09-16T15:02:10.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.223+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:02:10.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.235+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:02:10.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.259+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:02:10.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.259+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:02:10.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:02:10.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.267+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:02:10.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.283+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221af05f:::benchmark_data_smithi116_28801_object3602:head, will try copies on 0,4 2024-09-16T15:02:10.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.291+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:02:10.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.319+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:02:10.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.327+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:02:10.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 312 15 3405779 3405764 682.186 677.188 0.000841875 0.00145604 2024-09-16T15:02:10.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.379+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:02:10.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.395+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:02:10.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.403+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9991a93:::benchmark_data_smithi116_28801_object3057:head, will try copies on 2,3 2024-09-16T15:02:10.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.423+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f1aced5:::benchmark_data_smithi116_28801_object828:head, will try copies on 3,4 2024-09-16T15:02:10.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.435+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:02:10.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.455+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:02:10.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.463+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:02:10.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.471+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:02:10.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.499+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:02:10.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.515+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:02:10.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.515+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T15:02:10.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.531+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:02:10.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.543+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:02:10.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.543+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:10.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.587+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:02:10.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.587+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:02:10.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.619+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:02:10.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.635+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:02:10.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.659+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:02:10.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.667+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:02:10.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.675+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:02:10.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.687+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:02:10.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.719+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:02:10.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.723+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205294a3:::benchmark_data_smithi116_28801_object3565:head, will try copies on 0,4 2024-09-16T15:02:10.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.731+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:02:10.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.743+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a5d288e:::benchmark_data_smithi116_28801_object1692:head, will try copies on 3,4 2024-09-16T15:02:10.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.763+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:10.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.767+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:02:10.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.767+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:10.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:10.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.819+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:02:10.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.839+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T15:02:10.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.839+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981107fe:::benchmark_data_smithi116_28801_object477:head, will try copies on 0,4 2024-09-16T15:02:10.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.863+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:02:10.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.871+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:02:10.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.875+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:02:10.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.879+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:02:10.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.903+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:02:10.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.903+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:02:10.924 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db37641:::benchmark_data_smithi116_28801_object1167:head, will try copies on 3,4 2024-09-16T15:02:10.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.923+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:02:10.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.939+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:02:10.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.955+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:02:10.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.975+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f3b0db:::benchmark_data_smithi116_28801_object2438:head, will try copies on 0,4 2024-09-16T15:02:10.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:10.983+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:537ab502:::benchmark_data_smithi116_28801_object3103:head, will try copies on 3,4 2024-09-16T15:02:11.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.011+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:02:11.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.011+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:02:11.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:02:11.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.055+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:02:11.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.059+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:02:11.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.059+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:02:11.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.115+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:02:11.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.115+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:02:11.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.139+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:02:11.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.151+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:02:11.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.151+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:02:11.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.163+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:02:11.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.183+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:02:11.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:11.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.191+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:02:11.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.199+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:02:11.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.199+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:02:11.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.231+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:02:11.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.255+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:02:11.272 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.267+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:02:11.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.287+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:02:11.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.291+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:02:11.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.311+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T15:02:11.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.335+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:02:11.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.347+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961484ac:::benchmark_data_smithi116_28801_object1749:head, will try copies on 0,4 2024-09-16T15:02:11.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.351+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:02:11.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.375+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:02:11.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:02:11.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 313 16 3417106 3417090 682.268 707.875 0.000581074 0.00145586 2024-09-16T15:02:11.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.383+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59588748:::benchmark_data_smithi116_28801_object50:head, will try copies on 3,4 2024-09-16T15:02:11.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.411+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:02:11.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.431+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:02:11.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.435+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:02:11.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.435+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:02:11.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.451+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:02:11.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.479+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:02:11.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:02:11.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.519+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05f1a2:::benchmark_data_smithi116_28801_object1805:head, will try copies on 0,4 2024-09-16T15:02:11.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.539+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:02:11.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.543+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:02:11.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.559+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:02:11.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.559+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c32383c:::benchmark_data_smithi116_28801_object220:head, will try copies on 0,4 2024-09-16T15:02:11.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.559+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:02:11.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.583+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:02:11.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.611+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:02:11.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.627+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:02:11.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.659+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba927cbd:::benchmark_data_smithi116_28801_object995:head, will try copies on 2,3 2024-09-16T15:02:11.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.675+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:02:11.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.675+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:02:11.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.675+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:02:11.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.719+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:02:11.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.727+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:02:11.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.743+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a977078:::benchmark_data_smithi116_28801_object155:head, will try copies on 3,4 2024-09-16T15:02:11.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.751+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93809d91:::benchmark_data_smithi116_28801_object3207:head, will try copies on 0,4 2024-09-16T15:02:11.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.771+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:02:11.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.783+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:02:11.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.787+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:02:11.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.811+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:02:11.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.819+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T15:02:11.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.839+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:11.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.867+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T15:02:11.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.875+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:02:11.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.891+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:02:11.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.899+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:02:11.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.899+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:02:11.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.903+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T15:02:11.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.915+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e41a0d1:::benchmark_data_smithi116_28801_object847:head, will try copies on 0,4 2024-09-16T15:02:11.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.943+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:02:11.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.959+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:02:11.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.971+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:02:11.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.983+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:02:11.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:11.991+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T15:02:12.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.007+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:02:12.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.023+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:02:12.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.051+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:02:12.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.055+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:02:12.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.067+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:02:12.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.071+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:02:12.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.075+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T15:02:12.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.099+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:02:12.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.107+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:02:12.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.111+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:02:12.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.115+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:02:12.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.135+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:02:12.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.135+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:02:12.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.151+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:02:12.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.159+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T15:02:12.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.191+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:02:12.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.191+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:02:12.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.191+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:02:12.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.211+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T15:02:12.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.215+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T15:02:12.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.227+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:02:12.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.267+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:02:12.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.283+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:02:12.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.283+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:02:12.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.303+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:02:12.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.323+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:02:12.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.331+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:02:12.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.335+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:02:12.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.335+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:02:12.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.343+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:02:12.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.371+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:02:12.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 314 16 3427832 3427816 682.23 670.375 0.0009672 0.00145593 2024-09-16T15:02:12.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.435+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:02:12.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.455+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:12.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.495+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:02:12.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.527+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:02:12.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.547+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:12.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.559+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:02:12.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.575+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:12.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.587+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:12.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.595+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:02:12.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.607+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:02:12.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.607+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:02:12.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.619+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229d9906:::benchmark_data_smithi116_28801_object358:head, will try copies on 0,4 2024-09-16T15:02:12.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.651+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:02:12.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:02:12.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.671+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T15:02:12.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.671+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:02:12.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.679+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:02:12.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.679+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:12.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.711+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:02:12.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.711+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:02:12.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.719+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24fe9618:::benchmark_data_smithi116_28801_object267:head, will try copies on 0,4 2024-09-16T15:02:12.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.739+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:02:12.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.751+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:02:12.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.755+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:02:12.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.763+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T15:02:12.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.787+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:02:12.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.819+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:02:12.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.827+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:02:12.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.863+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T15:02:12.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.883+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:12.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.923+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:02:12.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.923+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:02:12.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.959+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:12.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.971+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:02:12.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.971+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8eccb4:::benchmark_data_smithi116_28801_object929:head, will try copies on 3,4 2024-09-16T15:02:13.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:12.999+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:02:13.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.019+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:02:13.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.039+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T15:02:13.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.039+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:02:13.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.067+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:02:13.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.071+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:02:13.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.079+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:02:13.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.087+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T15:02:13.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.115+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:02:13.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.119+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:02:13.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.131+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:02:13.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.131+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:02:13.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.147+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:02:13.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.151+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T15:02:13.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.179+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:02:13.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.191+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27838322:::benchmark_data_smithi116_28801_object3221:head, will try copies on 0,4 2024-09-16T15:02:13.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:02:13.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.219+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:13.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.251+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:02:13.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.275+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:13.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.279+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:13.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.295+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:02:13.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.303+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5701cc88:::benchmark_data_smithi116_28801_object3546:head, will try copies on 3,4 2024-09-16T15:02:13.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.307+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68be7dcb:::benchmark_data_smithi116_28801_object2060:head, will try copies on 3,4 2024-09-16T15:02:13.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.323+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce0e459:::benchmark_data_smithi116_28801_object2956:head, will try copies on 0,4 2024-09-16T15:02:13.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.331+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:02:13.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:02:13.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.359+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:02:13.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.359+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T15:02:13.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 315 16 3438221 3438205 682.125 649.312 0.000746473 0.00145615 2024-09-16T15:02:13.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.383+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:02:13.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.391+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:02:13.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.419+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:02:13.429 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.427+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:02:13.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.427+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:02:13.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.431+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:02:13.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.483+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:02:13.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.499+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:02:13.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.499+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:02:13.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.507+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:02:13.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.511+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:02:13.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.547+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:02:13.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.567+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:02:13.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c456db:::benchmark_data_smithi116_28801_object1521:head, will try copies on 3,4 2024-09-16T15:02:13.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.583+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2221b19b:::benchmark_data_smithi116_28801_object843:head, will try copies on 0,4 2024-09-16T15:02:13.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.623+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:02:13.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.639+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:02:13.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.639+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:02:13.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.643+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:02:13.650 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.647+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:13.672 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.667+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:02:13.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.695+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:02:13.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.699+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:02:13.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.707+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:02:13.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.727+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:02:13.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.735+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:02:13.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.775+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:02:13.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.787+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:02:13.796 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.791+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:02:13.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.827+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:02:13.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.847+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:02:13.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.851+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:02:13.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.871+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:02:13.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.907+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:02:13.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.919+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:02:13.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.935+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T15:02:13.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.943+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:02:13.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.951+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:02:13.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.951+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:02:13.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:13.955+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b65d88e9:::benchmark_data_smithi116_28801_object1470:head, will try copies on 2,3 2024-09-16T15:02:14.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.015+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:02:14.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.027+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:02:14.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.047+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970879e6:::benchmark_data_smithi116_28801_object639:head, will try copies on 0,4 2024-09-16T15:02:14.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.059+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:02:14.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.095+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:02:14.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.123+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:02:14.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.159+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T15:02:14.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.159+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:02:14.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.159+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:02:14.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.175+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:02:14.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.207+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:02:14.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.207+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:02:14.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.211+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:02:14.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.219+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:02:14.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.251+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:02:14.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.251+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:14.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.271+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:02:14.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.299+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:02:14.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.303+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:02:14.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.327+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:02:14.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.331+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:02:14.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.339+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:02:14.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.339+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:02:14.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.343+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T15:02:14.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.363+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:02:14.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.367+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:02:14.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.375+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:02:14.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 316 16 3449577 3449561 682.212 709.75 0.00066318 0.00145595 2024-09-16T15:02:14.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.399+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:02:14.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.411+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:02:14.432 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.427+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:02:14.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.435+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:02:14.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.443+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:14.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.475+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:02:14.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.483+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:02:14.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.487+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:02:14.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.515+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:02:14.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.535+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:02:14.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.559+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:02:14.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.563+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:02:14.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.591+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:02:14.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.631+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:02:14.653 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.651+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:02:14.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.675+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:02:14.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.679+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T15:02:14.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.711+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:02:14.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.719+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:02:14.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.735+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:02:14.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.755+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:02:14.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.759+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:02:14.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.779+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:02:14.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.795+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:02:14.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.799+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:02:14.813 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.811+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9763e69d:::benchmark_data_smithi116_28801_object2329:head, will try copies on 0,4 2024-09-16T15:02:14.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.819+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:02:14.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.831+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:02:14.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.847+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:02:14.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.851+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T15:02:14.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.891+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:02:14.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.895+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:02:14.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.903+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:14.909 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.903+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:02:14.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.923+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:14.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.931+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:02:14.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.955+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:02:14.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.955+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28860887:::benchmark_data_smithi116_28801_object3919:head, will try copies on 0,4 2024-09-16T15:02:14.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.959+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:02:14.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.987+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0c9bfe:::benchmark_data_smithi116_28801_object2386:head, will try copies on 3,4 2024-09-16T15:02:14.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:14.987+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8480720:::benchmark_data_smithi116_28801_object1866:head, will try copies on 2,3 2024-09-16T15:02:15.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.035+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:02:15.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.059+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:15.074 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.071+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:02:15.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.075+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:02:15.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.075+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:02:15.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.075+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:02:15.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.131+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:02:15.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.147+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:02:15.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.179+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:02:15.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T15:02:15.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.195+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:02:15.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.195+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:15.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.207+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T15:02:15.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.215+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73ae061:::benchmark_data_smithi116_28801_object2810:head, will try copies on 2,3 2024-09-16T15:02:15.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.247+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:02:15.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.275+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:02:15.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.279+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:02:15.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.283+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:02:15.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.283+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:02:15.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.283+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:02:15.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.331+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:02:15.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.343+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:02:15.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.351+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T15:02:15.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.367+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:02:15.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 317 16 3460613 3460597 682.236 689.75 0.00109178 0.00145593 2024-09-16T15:02:15.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.379+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:02:15.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:15.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.391+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:02:15.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.403+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:02:15.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.447+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933703ba:::benchmark_data_smithi116_28801_object2781:head, will try copies on 0,4 2024-09-16T15:02:15.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.451+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:02:15.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.455+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:02:15.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.463+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:02:15.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.499+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:02:15.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.515+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:02:15.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.519+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:02:15.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.519+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:02:15.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.555+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:02:15.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.559+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:02:15.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.583+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:02:15.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.603+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:02:15.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.611+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:02:15.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.611+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:02:15.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.643+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:02:15.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.647+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:02:15.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.651+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:02:15.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.667+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T15:02:15.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.667+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:02:15.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.687+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:02:15.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T15:02:15.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.715+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:15.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.719+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:02:15.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.719+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:02:15.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.747+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:02:15.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.747+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T15:02:15.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.775+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:02:15.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.803+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:664e912b:::benchmark_data_smithi116_28801_object4051:head, will try copies on 3,4 2024-09-16T15:02:15.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.815+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d374d9:::benchmark_data_smithi116_28801_object1788:head, will try copies on 3,4 2024-09-16T15:02:15.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.819+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:02:15.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.827+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:02:15.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.855+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:02:15.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.883+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:02:15.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.895+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:02:15.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.907+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:02:15.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.915+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:02:15.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.951+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:02:15.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.959+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:02:15.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.967+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T15:02:15.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:15.983+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:02:16.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.015+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:02:16.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.027+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:02:16.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.027+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:02:16.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.039+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:02:16.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.091+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:02:16.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.095+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:02:16.126 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.123+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:02:16.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.139+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T15:02:16.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.139+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:16.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.175+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:16.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.183+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:02:16.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.207+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:02:16.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.231+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:02:16.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.239+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:02:16.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.263+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:02:16.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.263+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:02:16.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.271+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:205e9505:::benchmark_data_smithi116_28801_object2793:head, will try copies on 0,4 2024-09-16T15:02:16.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.299+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:02:16.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.319+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:02:16.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.323+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:02:16.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.323+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T15:02:16.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.331+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:02:16.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.367+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:02:16.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.367+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:02:16.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.375+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:02:16.381 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 318 16 3471838 3471822 682.296 701.562 0.000875775 0.00145579 2024-09-16T15:02:16.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:02:16.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.399+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:02:16.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.411+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:02:16.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.459+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae1751c:::benchmark_data_smithi116_28801_object1160:head, will try copies on 3,4 2024-09-16T15:02:16.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.479+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae190df:::benchmark_data_smithi116_28801_object912:head, will try copies on 3,4 2024-09-16T15:02:16.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.479+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:02:16.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.491+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:02:16.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.511+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:02:16.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.527+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:02:16.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.531+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:02:16.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.559+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58933706:::benchmark_data_smithi116_28801_object1463:head, will try copies on 3,4 2024-09-16T15:02:16.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.559+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T15:02:16.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.563+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:02:16.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.567+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:02:16.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.587+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T15:02:16.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.599+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:02:16.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.603+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:02:16.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.611+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:02:16.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.631+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T15:02:16.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.647+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:02:16.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.651+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559bfb3b:::benchmark_data_smithi116_28801_object2519:head, will try copies on 3,4 2024-09-16T15:02:16.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.659+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T15:02:16.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.671+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T15:02:16.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.679+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:16.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.695+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:02:16.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.711+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:02:16.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.719+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:02:16.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.735+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:02:16.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.759+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:02:16.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.767+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:02:16.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:02:16.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.787+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:02:16.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.791+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:02:16.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.799+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:02:16.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.823+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T15:02:16.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.827+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:02:16.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.843+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:02:16.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.867+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69564b2d:::benchmark_data_smithi116_28801_object1599:head, will try copies on 3,4 2024-09-16T15:02:16.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.899+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:02:16.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.903+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57bd5786:::benchmark_data_smithi116_28801_object975:head, will try copies on 3,4 2024-09-16T15:02:16.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.903+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:02:16.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.943+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:02:16.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.979+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f43e843:::benchmark_data_smithi116_28801_object1279:head, will try copies on 0,4 2024-09-16T15:02:16.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.991+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:02:17.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:16.995+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffd0a6:::benchmark_data_smithi116_28801_object2988:head, will try copies on 3,4 2024-09-16T15:02:17.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.011+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:02:17.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.019+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:02:17.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.027+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:02:17.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.027+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T15:02:17.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.031+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:02:17.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.079+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:17.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.087+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:02:17.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.107+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:02:17.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.115+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:02:17.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.115+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:02:17.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.135+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:02:17.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.139+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b014bfdb:::benchmark_data_smithi116_28801_object1360:head, will try copies on 2,3 2024-09-16T15:02:17.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.151+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:17.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.183+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:02:17.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.199+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:02:17.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.203+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:02:17.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.207+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:02:17.216 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.211+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63156b69:::benchmark_data_smithi116_28801_object3534:head, will try copies on 3,4 2024-09-16T15:02:17.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.219+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:02:17.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.239+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:02:17.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:02:17.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.283+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:02:17.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.327+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:536208b5:::benchmark_data_smithi116_28801_object1428:head, will try copies on 3,4 2024-09-16T15:02:17.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.327+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:02:17.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.331+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:02:17.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.351+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:02:17.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.359+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T15:02:17.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.363+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:02:17.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.371+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:02:17.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 319 16 3482830 3482814 682.311 687 0.000576169 0.00145574 2024-09-16T15:02:17.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.403+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:02:17.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.419+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:02:17.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.427+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:02:17.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.439+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:02:17.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.447+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:02:17.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.451+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a88786d:::benchmark_data_smithi116_28801_object2385:head, will try copies on 0,4 2024-09-16T15:02:17.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.463+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ace81a8:::benchmark_data_smithi116_28801_object3505:head, will try copies on 3,4 2024-09-16T15:02:17.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.503+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:02:17.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.523+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:02:17.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.523+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:02:17.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.527+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:02:17.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.535+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:17.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.583+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:17.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.595+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:02:17.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.603+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2446ea91:::benchmark_data_smithi116_28801_object352:head, will try copies on 0,4 2024-09-16T15:02:17.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.615+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:02:17.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.627+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:02:17.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.639+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:02:17.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.647+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:02:17.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.651+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:02:17.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.675+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:17.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.707+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:02:17.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.715+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:02:17.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.727+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:02:17.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.735+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T15:02:17.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.755+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:02:17.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.763+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:02:17.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.767+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:02:17.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.771+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:02:17.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.779+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:02:17.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.783+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:02:17.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.791+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:02:17.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.819+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:02:17.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.859+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:02:17.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.867+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:02:17.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.899+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:02:17.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.903+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:02:17.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.923+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97923141:::benchmark_data_smithi116_28801_object2000:head, will try copies on 0,4 2024-09-16T15:02:17.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.927+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:02:17.969 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:17.963+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:02:18.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.047+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:02:18.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.055+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:02:18.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.071+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:02:18.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.075+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:02:18.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.075+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:02:18.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.079+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:18.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.087+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:02:18.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.099+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:02:18.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.123+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9953e0:::benchmark_data_smithi116_28801_object1054:head, will try copies on 0,4 2024-09-16T15:02:18.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.155+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:02:18.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.167+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:02:18.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.171+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:02:18.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.171+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:02:18.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.199+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:02:18.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.203+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:02:18.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.203+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:02:18.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.219+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:02:18.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.239+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T15:02:18.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.247+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:02:18.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.275+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:02:18.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.287+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf701ab6:::benchmark_data_smithi116_28801_object3929:head, will try copies on 2,3 2024-09-16T15:02:18.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.319+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:02:18.327 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.323+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:02:18.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.339+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:02:18.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.359+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:02:18.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:02:18.382964+0000 min lat: 0.000220162 max lat: 0.16813 avg lat: 0.00145571 2024-09-16T15:02:18.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:02:18.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 320 16 3493880 3493864 682.337 690.625 0.00109775 0.00145571 2024-09-16T15:02:18.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.383+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:02:18.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.383+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:02:18.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.415+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:02:18.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.427+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:02:18.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.431+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:02:18.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.451+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:02:18.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.467+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:02:18.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.471+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:02:18.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.479+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:02:18.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.503+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:18.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.503+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T15:02:18.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.515+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:02:18.550 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.547+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:02:18.558 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.555+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd044566:::benchmark_data_smithi116_28801_object514:head, will try copies on 2,3 2024-09-16T15:02:18.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b52895f:::benchmark_data_smithi116_28801_object687:head, will try copies on 0,4 2024-09-16T15:02:18.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.591+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b605384:::benchmark_data_smithi116_28801_object1863:head, will try copies on 0,4 2024-09-16T15:02:18.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.607+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:02:18.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.619+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:02:18.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.631+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:02:18.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.643+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:02:18.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.647+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:02:18.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.659+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:02:18.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.675+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:02:18.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.707+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:02:18.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.707+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:02:18.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.711+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b548bb95:::benchmark_data_smithi116_28801_object2852:head, will try copies on 2,3 2024-09-16T15:02:18.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.739+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:02:18.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.747+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:02:18.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.755+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:02:18.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.775+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T15:02:18.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.791+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9421cafe:::benchmark_data_smithi116_28801_object97:head, will try copies on 0,4 2024-09-16T15:02:18.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.807+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:02:18.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.807+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666c11d8:::benchmark_data_smithi116_28801_object3118:head, will try copies on 3,4 2024-09-16T15:02:18.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.815+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:02:18.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.831+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:02:18.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.835+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:02:18.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.835+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:02:18.862 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.855+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:02:18.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.883+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T15:02:18.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.895+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:02:18.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.907+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:02:18.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.911+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:02:18.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.919+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:02:18.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.947+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:02:18.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.979+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:02:18.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.987+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:02:18.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.987+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:02:19.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:18.999+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:02:19.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.007+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:19.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.035+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:02:19.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.043+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:02:19.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.051+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92437edf:::benchmark_data_smithi116_28801_object2145:head, will try copies on 0,4 2024-09-16T15:02:19.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.063+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:02:19.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.067+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8ece84:::benchmark_data_smithi116_28801_object69:head, will try copies on 3,4 2024-09-16T15:02:19.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.083+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:02:19.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.095+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:02:19.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.111+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:02:19.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.139+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T15:02:19.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.163+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:02:19.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.167+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T15:02:19.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.167+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2855af73:::benchmark_data_smithi116_28801_object2320:head, will try copies on 0,4 2024-09-16T15:02:19.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.175+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:02:19.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.219+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:02:19.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.227+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:02:19.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.251+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ce048c:::benchmark_data_smithi116_28801_object3027:head, will try copies on 2,3 2024-09-16T15:02:19.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.259+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:02:19.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.279+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:02:19.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.291+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:02:19.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.295+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:977e1c13:::benchmark_data_smithi116_28801_object4093:head, will try copies on 0,4 2024-09-16T15:02:19.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.311+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:02:19.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.319+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b790a:::benchmark_data_smithi116_28801_object3250:head, will try copies on 3,4 2024-09-16T15:02:19.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:19.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.355+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:02:19.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 321 16 3504810 3504794 682.339 683.125 0.00133342 0.00145571 2024-09-16T15:02:19.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.383+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:02:19.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.383+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be921dd0:::benchmark_data_smithi116_28801_object226:head, will try copies on 2,3 2024-09-16T15:02:19.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.395+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:19.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.403+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:02:19.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.411+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:02:19.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.411+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:02:19.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.415+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:02:19.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.459+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:02:19.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.479+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:02:19.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.491+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:02:19.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.495+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:02:19.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.499+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:02:19.531 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.527+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:19.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.531+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:02:19.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.539+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:02:19.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.571+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:02:19.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.575+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:02:19.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.599+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:02:19.602 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.599+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:02:19.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.607+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66dc8ff6:::benchmark_data_smithi116_28801_object3141:head, will try copies on 3,4 2024-09-16T15:02:19.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.627+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:02:19.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.627+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:02:19.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.627+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:690ca81a:::benchmark_data_smithi116_28801_object4106:head, will try copies on 3,4 2024-09-16T15:02:19.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.667+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:02:19.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.707+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:02:19.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.711+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:19.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.739+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:02:19.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.739+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936e7fba:::benchmark_data_smithi116_28801_object1237:head, will try copies on 0,4 2024-09-16T15:02:19.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.751+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:02:19.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.763+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0efbecc:::benchmark_data_smithi116_28801_object3672:head, will try copies on 2,3 2024-09-16T15:02:19.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.795+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:02:19.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.799+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:02:19.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.839+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:19.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.843+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:02:19.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.851+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:02:19.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.851+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fc934e:::benchmark_data_smithi116_28801_object615:head, will try copies on 2,3 2024-09-16T15:02:19.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.859+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6272204f:::benchmark_data_smithi116_28801_object3562:head, will try copies on 3,4 2024-09-16T15:02:19.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.915+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db142cb:::benchmark_data_smithi116_28801_object919:head, will try copies on 3,4 2024-09-16T15:02:19.923 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.919+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:02:19.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.947+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:02:19.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.955+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:02:19.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.955+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:02:19.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:19.967+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd51c06c:::benchmark_data_smithi116_28801_object611:head, will try copies on 2,3 2024-09-16T15:02:20.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.003+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:02:20.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.019+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T15:02:20.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.023+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:02:20.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.031+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:02:20.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.067+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T15:02:20.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.087+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:02:20.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.119+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T15:02:20.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.119+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:02:20.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.127+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5494d2d9:::benchmark_data_smithi116_28801_object576:head, will try copies on 3,4 2024-09-16T15:02:20.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.139+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:02:20.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.179+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:20.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.203+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:02:20.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.203+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:02:20.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.219+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:02:20.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.223+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:02:20.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.243+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:02:20.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.251+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:02:20.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.267+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:556b44f2:::benchmark_data_smithi116_28801_object3051:head, will try copies on 3,4 2024-09-16T15:02:20.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.291+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:02:20.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.315+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cf717de:::benchmark_data_smithi116_28801_object3334:head, will try copies on 3,4 2024-09-16T15:02:20.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.315+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:02:20.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.323+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c650d7:::benchmark_data_smithi116_28801_object3666:head, will try copies on 0,4 2024-09-16T15:02:20.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.347+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:02:20.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.355+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:02:20.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.355+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:02:20.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.359+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T15:02:20.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.363+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:20.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 322 16 3515883 3515867 682.369 692.062 0.000967456 0.00145563 2024-09-16T15:02:20.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.383+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:02:20.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.383+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:02:20.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.427+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:02:20.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.451+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:02:20.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.467+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:02:20.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.475+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:02:20.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.483+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T15:02:20.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.495+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e5fdea8:::benchmark_data_smithi116_28801_object163:head, will try copies on 0,4 2024-09-16T15:02:20.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.503+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:02:20.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.523+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:02:20.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.539+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:02:20.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.555+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:02:20.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.563+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:02:20.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.571+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:02:20.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.583+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T15:02:20.589 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.587+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:02:20.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.595+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:564760fd:::benchmark_data_smithi116_28801_object616:head, will try copies on 3,4 2024-09-16T15:02:20.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.607+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f767a87:::benchmark_data_smithi116_28801_object2967:head, will try copies on 0,4 2024-09-16T15:02:20.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.611+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:02:20.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.619+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6427ed:::benchmark_data_smithi116_28801_object3453:head, will try copies on 0,4 2024-09-16T15:02:20.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.679+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:02:20.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.683+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:02:20.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.687+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23576285:::benchmark_data_smithi116_28801_object1693:head, will try copies on 0,4 2024-09-16T15:02:20.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.699+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:02:20.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.719+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:02:20.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.727+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T15:02:20.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.735+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:02:20.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.771+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T15:02:20.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.791+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T15:02:20.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.799+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:02:20.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.803+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64df543:::benchmark_data_smithi116_28801_object4054:head, will try copies on 2,3 2024-09-16T15:02:20.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.827+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5965a080:::benchmark_data_smithi116_28801_object2774:head, will try copies on 3,4 2024-09-16T15:02:20.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.847+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:02:20.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.863+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:20.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.875+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T15:02:20.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.915+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:02:20.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.915+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:02:20.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.939+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7db14d:::benchmark_data_smithi116_28801_object1835:head, will try copies on 3,4 2024-09-16T15:02:20.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.947+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:02:20.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.967+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:02:20.990 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.987+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:02:20.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:20.991+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:02:21.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.023+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:02:21.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.023+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:02:21.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.031+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:02:21.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.063+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:02:21.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.063+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:02:21.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.067+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:02:21.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.087+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6413d592:::benchmark_data_smithi116_28801_object3075:head, will try copies on 3,4 2024-09-16T15:02:21.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.119+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:02:21.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.131+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:21.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.135+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:02:21.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.183+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:02:21.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.191+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:02:21.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.215+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e3bb6ed:::benchmark_data_smithi116_28801_object3909:head, will try copies on 3,4 2024-09-16T15:02:21.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.223+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:02:21.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.239+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:02:21.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.255+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a55e820:::benchmark_data_smithi116_28801_object391:head, will try copies on 3,4 2024-09-16T15:02:21.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.263+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:02:21.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.279+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22b3af8c:::benchmark_data_smithi116_28801_object2889:head, will try copies on 0,4 2024-09-16T15:02:21.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.319+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:02:21.344 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.339+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:02:21.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.343+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:02:21.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.355+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:02:21.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.363+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:02:21.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 323 16 3527107 3527091 682.428 701.5 0.000975077 0.00145551 2024-09-16T15:02:21.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.407+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:02:21.420 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.415+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:02:21.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.431+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9866cbd0:::benchmark_data_smithi116_28801_object515:head, will try copies on 0,4 2024-09-16T15:02:21.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.447+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:02:21.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.467+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:02:21.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.471+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:02:21.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.471+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:02:21.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.507+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:02:21.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.519+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:02:21.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.519+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:02:21.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.555+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6024d89c:::benchmark_data_smithi116_28801_object1541:head, will try copies on 3,4 2024-09-16T15:02:21.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.591+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26faef05:::benchmark_data_smithi116_28801_object3180:head, will try copies on 0,4 2024-09-16T15:02:21.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.603+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:02:21.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.607+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:02:21.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.635+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91210bde:::benchmark_data_smithi116_28801_object40:head, will try copies on 0,4 2024-09-16T15:02:21.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.663+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T15:02:21.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.687+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:02:21.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.699+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:02:21.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.711+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:02:21.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.719+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:02:21.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.723+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:02:21.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.735+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:02:21.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.759+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:02:21.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.791+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:21.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.795+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:02:21.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.799+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:02:21.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.803+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T15:02:21.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.811+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:02:21.882 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.879+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5477c394:::benchmark_data_smithi116_28801_object35:head, will try copies on 3,4 2024-09-16T15:02:21.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.887+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:02:21.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.931+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e34f52e:::benchmark_data_smithi116_28801_object82:head, will try copies on 3,4 2024-09-16T15:02:21.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.947+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:02:21.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.959+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:02:21.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.987+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:02:21.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.995+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:02:22.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:21.999+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:02:22.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.019+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:02:22.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.035+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:936dbb57:::benchmark_data_smithi116_28801_object2745:head, will try copies on 0,4 2024-09-16T15:02:22.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.047+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:02:22.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.051+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:02:22.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.087+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:02:22.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.087+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:02:22.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.107+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:02:22.118 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.115+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:02:22.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.127+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c737a47:::benchmark_data_smithi116_28801_object1926:head, will try copies on 0,4 2024-09-16T15:02:22.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.143+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:02:22.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.147+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:542d4001:::benchmark_data_smithi116_28801_object2648:head, will try copies on 3,4 2024-09-16T15:02:22.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.151+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:02:22.191 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.187+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:02:22.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.187+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f40a45e:::benchmark_data_smithi116_28801_object2415:head, will try copies on 3,4 2024-09-16T15:02:22.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.203+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:02:22.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.227+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a06a54f:::benchmark_data_smithi116_28801_object2274:head, will try copies on 3,4 2024-09-16T15:02:22.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.243+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:02:22.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.251+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:02:22.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.259+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:02:22.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.295+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:02:22.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.295+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:02:22.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.307+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:02:22.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.331+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53786788:::benchmark_data_smithi116_28801_object659:head, will try copies on 3,4 2024-09-16T15:02:22.348 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.343+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T15:02:22.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 324 15 3538565 3538550 682.532 716.188 0.00186728 0.00145529 2024-09-16T15:02:22.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.391+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T15:02:22.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.391+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:02:22.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.395+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c63f5c:::benchmark_data_smithi116_28801_object1802:head, will try copies on 3,4 2024-09-16T15:02:22.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.399+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:02:22.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.403+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:02:22.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.415+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:02:22.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.518+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:02:22.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.554+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:02:22.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.558+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:02:22.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.558+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:02:22.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.590+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:02:22.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.614+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:22.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.614+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:02:22.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.618+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:22.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:02:22.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.658+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:02:22.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.662+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:02:22.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.686+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:02:22.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.686+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T15:02:22.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.698+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:02:22.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.698+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T15:02:22.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.726+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:02:22.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.742+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:02:22.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.770+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:02:22.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.778+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:02:22.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.786+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:02:22.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.802+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:02:22.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.802+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:02:22.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.818+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T15:02:22.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.862+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T15:02:22.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb098a61:::benchmark_data_smithi116_28801_object2545:head, will try copies on 2,3 2024-09-16T15:02:22.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.906+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:02:22.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.910+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:02:22.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.914+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T15:02:22.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.930+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:02:22.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.946+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce2d432:::benchmark_data_smithi116_28801_object2491:head, will try copies on 0,4 2024-09-16T15:02:22.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.966+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:02:22.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.990+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:02:23.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:22.998+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:23.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.014+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:02:23.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.034+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:02:23.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.042+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:02:23.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.058+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:02:23.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.062+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:02:23.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.086+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:02:23.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.098+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9577f163:::benchmark_data_smithi116_28801_object3933:head, will try copies on 0,4 2024-09-16T15:02:23.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.102+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f295bff:::benchmark_data_smithi116_28801_object1820:head, will try copies on 0,4 2024-09-16T15:02:23.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.106+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:23.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.118+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:02:23.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.138+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:02:23.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.146+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b58f10cd:::benchmark_data_smithi116_28801_object1997:head, will try copies on 2,3 2024-09-16T15:02:23.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.162+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29bb74e7:::benchmark_data_smithi116_28801_object1815:head, will try copies on 0,4 2024-09-16T15:02:23.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.190+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558c0e53:::benchmark_data_smithi116_28801_object2210:head, will try copies on 3,4 2024-09-16T15:02:23.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.198+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b82c5b6:::benchmark_data_smithi116_28801_object3192:head, will try copies on 0,4 2024-09-16T15:02:23.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.202+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a400f4d:::benchmark_data_smithi116_28801_object2104:head, will try copies on 0,4 2024-09-16T15:02:23.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.230+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:02:23.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.230+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:02:23.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.250+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5080a10a:::benchmark_data_smithi116_28801_object3212:head, will try copies on 3,4 2024-09-16T15:02:23.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.254+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:02:23.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.274+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:02:23.281 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.278+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:02:23.286 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.282+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:02:23.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.282+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:02:23.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.302+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:23.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.314+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:23.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.342+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:02:23.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.358+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f9c122b:::benchmark_data_smithi116_28801_object2039:head, will try copies on 3,4 2024-09-16T15:02:23.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.358+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:02:23.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 325 16 3549658 3549642 682.565 693.25 0.000709499 0.00145522 2024-09-16T15:02:23.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.378+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:02:23.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.386+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:23.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.394+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb2b6ae9:::benchmark_data_smithi116_28801_object3257:head, will try copies on 2,3 2024-09-16T15:02:23.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.406+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:02:23.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.442+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:02:23.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:02:23.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.450+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:02:23.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.458+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:02:23.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.470+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4880738:::benchmark_data_smithi116_28801_object3704:head, will try copies on 2,3 2024-09-16T15:02:23.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.474+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:02:23.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.486+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:02:23.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.526+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:02:23.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.534+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4a919d:::benchmark_data_smithi116_28801_object437:head, will try copies on 0,4 2024-09-16T15:02:23.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.546+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T15:02:23.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.554+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:02:23.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.570+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d39c1:::benchmark_data_smithi116_28801_object1301:head, will try copies on 2,3 2024-09-16T15:02:23.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.574+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:02:23.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.594+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:02:23.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.594+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:02:23.620 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.614+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:02:23.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.642+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:02:23.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.658+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:02:23.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.662+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59786278:::benchmark_data_smithi116_28801_object613:head, will try copies on 3,4 2024-09-16T15:02:23.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.690+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:02:23.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.710+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:02:23.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.722+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:02:23.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.726+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:02:23.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.734+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:02:23.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.762+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:02:23.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.782+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:23.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.786+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T15:02:23.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.814+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:02:23.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.814+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:02:23.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.818+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:02:23.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.830+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:02:23.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d51039:::benchmark_data_smithi116_28801_object2537:head, will try copies on 0,4 2024-09-16T15:02:23.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.894+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:02:23.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.902+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:02:23.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.970+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T15:02:23.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.974+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ada9d3f:::benchmark_data_smithi116_28801_object1579:head, will try copies on 0,4 2024-09-16T15:02:23.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.986+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T15:02:23.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:02:24.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:23.998+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:02:24.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.026+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:02:24.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.046+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dfd9b19:::benchmark_data_smithi116_28801_object3448:head, will try copies on 0,4 2024-09-16T15:02:24.054 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.050+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:02:24.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.062+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:02:24.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.062+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:02:24.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.070+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:02:24.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.094+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:02:24.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.130+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:02:24.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.138+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:02:24.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.146+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:02:24.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.162+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d0cb926:::benchmark_data_smithi116_28801_object2798:head, will try copies on 0,4 2024-09-16T15:02:24.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.166+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:02:24.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.178+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:02:24.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.186+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:02:24.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.214+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b635780:::benchmark_data_smithi116_28801_object1480:head, will try copies on 0,4 2024-09-16T15:02:24.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.234+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:02:24.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.234+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:02:24.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.238+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:24.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.258+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:02:24.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.262+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:02:24.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.266+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:02:24.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.298+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bee8a3ad:::benchmark_data_smithi116_28801_object2516:head, will try copies on 2,3 2024-09-16T15:02:24.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.334+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:24.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.342+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:02:24.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.362+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:02:24.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 326 16 3560822 3560806 682.611 697.75 0.00216654 0.00145512 2024-09-16T15:02:24.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.378+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:02:24.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.398+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:02:24.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.410+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:02:24.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.430+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:02:24.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.442+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:02:24.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.446+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:02:24.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.458+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d626a9f:::benchmark_data_smithi116_28801_object298:head, will try copies on 0,4 2024-09-16T15:02:24.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.466+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd675c:::benchmark_data_smithi116_28801_object568:head, will try copies on 3,4 2024-09-16T15:02:24.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.466+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:02:24.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:02:24.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.494+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:02:24.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.538+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:02:24.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.542+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:02:24.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.550+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:02:24.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.562+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:02:24.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.578+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f00da6e:::benchmark_data_smithi116_28801_object1768:head, will try copies on 0,4 2024-09-16T15:02:24.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.602+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:02:24.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.606+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f1765a:::benchmark_data_smithi116_28801_object419:head, will try copies on 3,4 2024-09-16T15:02:24.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.638+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:02:24.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.662+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T15:02:24.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.662+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:02:24.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.678+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94078999:::benchmark_data_smithi116_28801_object2499:head, will try copies on 0,4 2024-09-16T15:02:24.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.686+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:02:24.696 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.690+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:02:24.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.710+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02b447f:::benchmark_data_smithi116_28801_object3968:head, will try copies on 2,3 2024-09-16T15:02:24.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.730+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:02:24.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.734+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:02:24.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.754+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd5fdbd3:::benchmark_data_smithi116_28801_object1658:head, will try copies on 2,3 2024-09-16T15:02:24.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.774+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:02:24.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.778+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:02:24.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.786+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:02:24.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.794+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:02:24.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.818+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff82f94:::benchmark_data_smithi116_28801_object4097:head, will try copies on 3,4 2024-09-16T15:02:24.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.854+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T15:02:24.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.890+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T15:02:24.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.906+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:02:24.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.910+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:02:24.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.942+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:02:24.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.970+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:02:24.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.978+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:02:24.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:24.990+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:25.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.006+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:25.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.026+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:02:25.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.030+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T15:02:25.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.054+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:02:25.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.062+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:02:25.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.066+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:02:25.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.074+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T15:02:25.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.090+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:02:25.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.090+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:02:25.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.122+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:02:25.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.126+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:02:25.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.126+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:02:25.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.126+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:02:25.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.186+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:02:25.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.186+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:02:25.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.210+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac5ae37:::benchmark_data_smithi116_28801_object736:head, will try copies on 0,4 2024-09-16T15:02:25.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.226+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:02:25.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.246+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:02:25.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.246+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:02:25.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.266+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92278ac:::benchmark_data_smithi116_28801_object2886:head, will try copies on 2,3 2024-09-16T15:02:25.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.274+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:25.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.286+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6075c114:::benchmark_data_smithi116_28801_object941:head, will try copies on 3,4 2024-09-16T15:02:25.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.290+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:02:25.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.302+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:02:25.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.326+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:02:25.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.350+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:25.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.354+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:02:25.381 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:02:25.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 327 16 3571716 3571700 682.606 680.875 0.00171482 0.00145513 2024-09-16T15:02:25.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.390+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62db5bf1:::benchmark_data_smithi116_28801_object253:head, will try copies on 3,4 2024-09-16T15:02:25.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.390+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:02:25.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.402+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:02:25.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.406+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:02:25.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.426+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:02:25.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.466+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:02:25.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.470+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:25.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.478+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:02:25.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.498+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:02:25.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.506+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:02:25.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.506+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3244801:::benchmark_data_smithi116_28801_object2647:head, will try copies on 2,3 2024-09-16T15:02:25.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.506+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94973e93:::benchmark_data_smithi116_28801_object3209:head, will try copies on 0,4 2024-09-16T15:02:25.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.534+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:02:25.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.578+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:02:25.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.578+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T15:02:25.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.590+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:25.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.626+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b620f14e:::benchmark_data_smithi116_28801_object2588:head, will try copies on 2,3 2024-09-16T15:02:25.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.630+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a287410:::benchmark_data_smithi116_28801_object996:head, will try copies on 0,4 2024-09-16T15:02:25.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.658+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555cad1f:::benchmark_data_smithi116_28801_object15:head, will try copies on 3,4 2024-09-16T15:02:25.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.686+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:02:25.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.702+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64268983:::benchmark_data_smithi116_28801_object2095:head, will try copies on 3,4 2024-09-16T15:02:25.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.718+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:02:25.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.742+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:02:25.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.762+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T15:02:25.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.766+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559c92b9:::benchmark_data_smithi116_28801_object802:head, will try copies on 3,4 2024-09-16T15:02:25.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:02:25.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.790+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:25.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.802+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:02:25.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.814+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:02:25.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.822+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T15:02:25.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.830+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:02:25.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.862+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:02:25.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.874+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T15:02:25.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.882+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6babbda6:::benchmark_data_smithi116_28801_object3514:head, will try copies on 3,4 2024-09-16T15:02:25.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:02:25.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.954+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:02:25.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.970+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:02:25.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.974+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:02:25.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.994+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:02:26.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.998+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T15:02:26.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:25.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:02:26.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.026+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b01c247:::benchmark_data_smithi116_28801_object1128:head, will try copies on 0,4 2024-09-16T15:02:26.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.034+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T15:02:26.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.046+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:26.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.066+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:02:26.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.074+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:02:26.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.086+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:02:26.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.094+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:02:26.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.102+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T15:02:26.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.150+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:02:26.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.158+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:02:26.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.162+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:26.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.166+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:02:26.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.170+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:02:26.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.174+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:02:26.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.198+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:02:26.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.238+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:02:26.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.238+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:02:26.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.246+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:02:26.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.262+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T15:02:26.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.294+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:02:26.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.306+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:02:26.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.318+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:26.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.334+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c789866:::benchmark_data_smithi116_28801_object900:head, will try copies on 3,4 2024-09-16T15:02:26.364 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.358+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55520f3a:::benchmark_data_smithi116_28801_object768:head, will try copies on 3,4 2024-09-16T15:02:26.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 328 16 3582614 3582598 682.601 681.125 0.00149764 0.00145515 2024-09-16T15:02:26.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.382+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:02:26.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.382+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f1ff3b8:::benchmark_data_smithi116_28801_object1087:head, will try copies on 0,4 2024-09-16T15:02:26.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:02:26.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.390+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:02:26.415 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.410+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97373af9:::benchmark_data_smithi116_28801_object364:head, will try copies on 0,4 2024-09-16T15:02:26.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.414+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:02:26.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.434+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:02:26.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.438+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:02:26.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.454+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:02:26.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.482+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:02:26.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.486+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:02:26.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.490+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b7f80de:::benchmark_data_smithi116_28801_object746:head, will try copies on 3,4 2024-09-16T15:02:26.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.514+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:02:26.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.534+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:02:26.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.546+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:02:26.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.550+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:02:26.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.558+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:02:26.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.570+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T15:02:26.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.598+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b99fde:::benchmark_data_smithi116_28801_object432:head, will try copies on 3,4 2024-09-16T15:02:26.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.598+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dab597e:::benchmark_data_smithi116_28801_object2861:head, will try copies on 3,4 2024-09-16T15:02:26.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.614+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:02:26.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.618+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2262c5e:::benchmark_data_smithi116_28801_object3321:head, will try copies on 2,3 2024-09-16T15:02:26.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.630+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:02:26.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.658+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:02:26.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.678+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:02:26.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.694+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:02:26.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.698+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:02:26.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.726+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:02:26.734 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.730+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:02:26.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.766+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:02:26.774 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:02:26.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.774+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:02:26.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.782+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:26.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.794+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:02:26.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.802+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:02:26.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.818+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:02:26.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.830+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534eae0c:::benchmark_data_smithi116_28801_object1515:head, will try copies on 3,4 2024-09-16T15:02:26.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.838+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:02:26.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.842+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T15:02:26.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.882+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:02:26.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.886+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:02:26.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.890+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:26.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.898+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:02:26.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.910+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eafba6f:::benchmark_data_smithi116_28801_object953:head, will try copies on 0,4 2024-09-16T15:02:26.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.918+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:02:26.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.950+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:02:26.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.950+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:26.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.970+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:02:26.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.986+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d400f64:::benchmark_data_smithi116_28801_object1374:head, will try copies on 3,4 2024-09-16T15:02:27.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:26.998+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6146985b:::benchmark_data_smithi116_28801_object1830:head, will try copies on 3,4 2024-09-16T15:02:27.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.002+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:02:27.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.010+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6b87a7:::benchmark_data_smithi116_28801_object3670:head, will try copies on 2,3 2024-09-16T15:02:27.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.010+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:02:27.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.022+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ae2a74:::benchmark_data_smithi116_28801_object3517:head, will try copies on 3,4 2024-09-16T15:02:27.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.058+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:27.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.086+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a7f923a:::benchmark_data_smithi116_28801_object1427:head, will try copies on 0,4 2024-09-16T15:02:27.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.086+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T15:02:27.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.110+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:02:27.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.126+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268791b:::benchmark_data_smithi116_28801_object918:head, will try copies on 0,4 2024-09-16T15:02:27.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.142+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc8caeb:::benchmark_data_smithi116_28801_object1651:head, will try copies on 0,4 2024-09-16T15:02:27.180 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.174+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:02:27.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.190+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:02:27.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.194+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:02:27.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.198+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:02:27.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.206+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:02:27.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.226+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e6776a0:::benchmark_data_smithi116_28801_object47:head, will try copies on 3,4 2024-09-16T15:02:27.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.254+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:02:27.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.258+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:02:27.273 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.270+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:02:27.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.290+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:02:27.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:27.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.302+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:02:27.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.334+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6df38a30:::benchmark_data_smithi116_28801_object3827:head, will try copies on 3,4 2024-09-16T15:02:27.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.346+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:02:27.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.354+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:02:27.382 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 329 16 3593438 3593422 682.582 676.5 0.00100323 0.00145519 2024-09-16T15:02:27.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.382+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:02:27.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.418+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:02:27.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.422+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:02:27.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.438+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:02:27.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.462+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:02:27.477 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.474+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T15:02:27.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.490+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:02:27.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.490+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:02:27.498 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.494+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:02:27.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.554+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a269e85:::benchmark_data_smithi116_28801_object822:head, will try copies on 3,4 2024-09-16T15:02:27.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.574+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:02:27.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.574+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2dc0385c:::benchmark_data_smithi116_28801_object3723:head, will try copies on 0,4 2024-09-16T15:02:27.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.602+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:02:27.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.606+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:02:27.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.622+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:02:27.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.634+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d144dec:::benchmark_data_smithi116_28801_object2007:head, will try copies on 3,4 2024-09-16T15:02:27.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.654+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a73610a:::benchmark_data_smithi116_28801_object1468:head, will try copies on 3,4 2024-09-16T15:02:27.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.654+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:02:27.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.662+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:02:27.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.682+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:02:27.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.706+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:02:27.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.726+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ecb70f8:::benchmark_data_smithi116_28801_object624:head, will try copies on 3,4 2024-09-16T15:02:27.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.738+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T15:02:27.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.762+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:02:27.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.778+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:02:27.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.794+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:02:27.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.798+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:02:27.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T15:02:27.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.814+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:02:27.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.838+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:02:27.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.842+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:02:27.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.846+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:02:27.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.874+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:02:27.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.878+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:02:27.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.914+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:02:27.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.930+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b013559:::benchmark_data_smithi116_28801_object91:head, will try copies on 0,4 2024-09-16T15:02:27.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.950+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:02:27.971 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.966+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:02:27.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.970+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:02:27.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a74a554:::benchmark_data_smithi116_28801_object211:head, will try copies on 0,4 2024-09-16T15:02:27.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.978+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:02:27.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.990+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:02:27.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:27.990+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5572ea43:::benchmark_data_smithi116_28801_object3459:head, will try copies on 3,4 2024-09-16T15:02:28.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.006+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:02:28.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.018+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:02:28.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.042+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:02:28.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.046+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:02:28.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.058+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:02:28.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.082+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:02:28.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.090+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:02:28.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.098+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e2535b:::benchmark_data_smithi116_28801_object2606:head, will try copies on 2,3 2024-09-16T15:02:28.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.102+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:02:28.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.110+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e873df:::benchmark_data_smithi116_28801_object3435:head, will try copies on 0,4 2024-09-16T15:02:28.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.150+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:02:28.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.154+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T15:02:28.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.190+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:02:28.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:02:28.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.206+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdacba6b:::benchmark_data_smithi116_28801_object593:head, will try copies on 2,3 2024-09-16T15:02:28.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.230+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53963fe3:::benchmark_data_smithi116_28801_object2496:head, will try copies on 3,4 2024-09-16T15:02:28.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.234+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc89413d:::benchmark_data_smithi116_28801_object669:head, will try copies on 2,3 2024-09-16T15:02:28.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.234+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96abf632:::benchmark_data_smithi116_28801_object2777:head, will try copies on 0,4 2024-09-16T15:02:28.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.254+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:515847fb:::benchmark_data_smithi116_28801_object2127:head, will try copies on 3,4 2024-09-16T15:02:28.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.262+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:02:28.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.262+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65af9798:::benchmark_data_smithi116_28801_object3825:head, will try copies on 3,4 2024-09-16T15:02:28.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.286+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:02:28.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.306+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:02:28.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.326+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:02:28.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.350+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:02:28.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.354+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:02:28.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 330 16 3604455 3604439 682.6 688.562 0.000818198 0.00145514 2024-09-16T15:02:28.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.382+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:02:28.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.390+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:28.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.430+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e85ef4a:::benchmark_data_smithi116_28801_object3921:head, will try copies on 0,4 2024-09-16T15:02:28.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.434+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:02:28.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.438+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:02:28.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.454+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:02:28.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.454+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:28.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.462+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:02:28.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.474+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:28.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.490+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:02:28.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:02:28.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.550+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:02:28.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.582+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96c5f327:::benchmark_data_smithi116_28801_object261:head, will try copies on 0,4 2024-09-16T15:02:28.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.594+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b792de35:::benchmark_data_smithi116_28801_object4046:head, will try copies on 2,3 2024-09-16T15:02:28.613 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.610+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:02:28.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.618+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:02:28.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.626+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:02:28.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.646+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b05261a:::benchmark_data_smithi116_28801_object1721:head, will try copies on 3,4 2024-09-16T15:02:28.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.654+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:02:28.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.670+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce448e0:::benchmark_data_smithi116_28801_object3336:head, will try copies on 0,4 2024-09-16T15:02:28.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.674+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22af8ce8:::benchmark_data_smithi116_28801_object2658:head, will try copies on 0,4 2024-09-16T15:02:28.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.682+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8ab76e:::benchmark_data_smithi116_28801_object238:head, will try copies on 3,4 2024-09-16T15:02:28.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.682+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:02:28.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.706+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2de683f7:::benchmark_data_smithi116_28801_object3847:head, will try copies on 0,4 2024-09-16T15:02:28.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.734+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6fb0:::benchmark_data_smithi116_28801_object949:head, will try copies on 0,4 2024-09-16T15:02:28.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.738+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:02:28.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.742+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:02:28.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.754+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:02:28.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.770+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:28.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.786+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ff2daa:::benchmark_data_smithi116_28801_object3422:head, will try copies on 3,4 2024-09-16T15:02:28.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.814+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:02:28.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.822+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f38cafb:::benchmark_data_smithi116_28801_object164:head, will try copies on 0,4 2024-09-16T15:02:28.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.846+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:02:28.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:02:28.872 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.866+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ae48bba:::benchmark_data_smithi116_28801_object1351:head, will try copies on 3,4 2024-09-16T15:02:28.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.878+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:02:28.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.910+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:02:28.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.914+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29258f6d:::benchmark_data_smithi116_28801_object2133:head, will try copies on 0,4 2024-09-16T15:02:28.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.942+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b64e4dde:::benchmark_data_smithi116_28801_object899:head, will try copies on 2,3 2024-09-16T15:02:28.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.962+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:02:28.967 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.962+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:02:28.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.978+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:02:29.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:28.994+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:02:29.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.006+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:02:29.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.026+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:02:29.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.038+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70a0ca3:::benchmark_data_smithi116_28801_object2874:head, will try copies on 2,3 2024-09-16T15:02:29.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.046+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:02:29.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.062+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:02:29.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.078+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T15:02:29.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.082+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97190a9a:::benchmark_data_smithi116_28801_object1080:head, will try copies on 0,4 2024-09-16T15:02:29.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.102+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b4f897:::benchmark_data_smithi116_28801_object3101:head, will try copies on 0,4 2024-09-16T15:02:29.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.106+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:02:29.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.110+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:02:29.124 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.118+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:02:29.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.142+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:02:29.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.146+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:02:29.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.198+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25374a31:::benchmark_data_smithi116_28801_object2544:head, will try copies on 0,4 2024-09-16T15:02:29.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.202+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:02:29.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.230+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:02:29.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.242+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:02:29.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.246+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c8f658e:::benchmark_data_smithi116_28801_object153:head, will try copies on 0,4 2024-09-16T15:02:29.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.258+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:02:29.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.270+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:02:29.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.294+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:02:29.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.302+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69926152:::benchmark_data_smithi116_28801_object2180:head, will try copies on 3,4 2024-09-16T15:02:29.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.310+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:02:29.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.318+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:02:29.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.334+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:29.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.334+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:29.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.366+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:02:29.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 331 16 3615347 3615331 682.595 680.75 0.00295943 0.00145514 2024-09-16T15:02:29.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.378+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:02:29.394 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.390+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad5327b:::benchmark_data_smithi116_28801_object865:head, will try copies on 3,4 2024-09-16T15:02:29.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.398+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:02:29.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.414+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:02:29.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.422+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:02:29.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.434+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T15:02:29.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.450+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:02:29.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.454+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:02:29.481 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.478+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:02:29.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.506+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T15:02:29.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.514+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:02:29.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.522+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:02:29.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.530+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T15:02:29.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.530+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T15:02:29.553 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.550+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d761219:::benchmark_data_smithi116_28801_object1127:head, will try copies on 3,4 2024-09-16T15:02:29.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.554+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b549360f:::benchmark_data_smithi116_28801_object3544:head, will try copies on 2,3 2024-09-16T15:02:29.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.602+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:02:29.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.606+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23019ee0:::benchmark_data_smithi116_28801_object3698:head, will try copies on 0,4 2024-09-16T15:02:29.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.622+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:02:29.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.630+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:02:29.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.630+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:02:29.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.662+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9534c324:::benchmark_data_smithi116_28801_object277:head, will try copies on 0,4 2024-09-16T15:02:29.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.666+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1a0013:::benchmark_data_smithi116_28801_object2819:head, will try copies on 0,4 2024-09-16T15:02:29.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.690+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:02:29.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.706+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:02:29.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.710+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:02:29.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.730+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:02:29.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.742+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:02:29.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.754+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:02:29.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.754+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:02:29.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.782+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:02:29.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.790+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:02:29.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.798+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63e143ac:::benchmark_data_smithi116_28801_object1531:head, will try copies on 3,4 2024-09-16T15:02:29.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.830+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69195188:::benchmark_data_smithi116_28801_object3735:head, will try copies on 3,4 2024-09-16T15:02:29.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.850+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:02:29.858 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.854+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59a1728:::benchmark_data_smithi116_28801_object2660:head, will try copies on 2,3 2024-09-16T15:02:29.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.858+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:02:29.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.902+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99141ddf:::benchmark_data_smithi116_28801_object3537:head, will try copies on 0,4 2024-09-16T15:02:29.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.906+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd8b1f7:::benchmark_data_smithi116_28801_object512:head, will try copies on 3,4 2024-09-16T15:02:29.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.906+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:02:29.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.910+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2004d4d:::benchmark_data_smithi116_28801_object1816:head, will try copies on 2,3 2024-09-16T15:02:29.929 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.922+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:02:29.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.958+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:02:29.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.962+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:02:30.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:29.994+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T15:02:30.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.002+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:02:30.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.002+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5677a6df:::benchmark_data_smithi116_28801_object248:head, will try copies on 3,4 2024-09-16T15:02:30.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.014+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:02:30.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.022+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:02:30.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.046+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:02:30.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.066+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e45abbd:::benchmark_data_smithi116_28801_object2751:head, will try copies on 0,4 2024-09-16T15:02:30.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.082+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b41ccb6a:::benchmark_data_smithi116_28801_object1132:head, will try copies on 2,3 2024-09-16T15:02:30.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.090+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685f5284:::benchmark_data_smithi116_28801_object2580:head, will try copies on 3,4 2024-09-16T15:02:30.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.130+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:02:30.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.138+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff674f7:::benchmark_data_smithi116_28801_object1590:head, will try copies on 0,4 2024-09-16T15:02:30.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.146+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:02:30.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.154+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:02:30.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.154+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:02:30.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.158+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:02:30.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:02:30.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.206+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:02:30.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.230+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b7484:::benchmark_data_smithi116_28801_object1902:head, will try copies on 3,4 2024-09-16T15:02:30.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.234+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90bcc96c:::benchmark_data_smithi116_28801_object255:head, will try copies on 0,4 2024-09-16T15:02:30.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.278+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:02:30.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.282+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:02:30.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.286+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f6216a:::benchmark_data_smithi116_28801_object3263:head, will try copies on 3,4 2024-09-16T15:02:30.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.326+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ccfc910:::benchmark_data_smithi116_28801_object157:head, will try copies on 3,4 2024-09-16T15:02:30.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.358+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231d8329:::benchmark_data_smithi116_28801_object1627:head, will try copies on 0,4 2024-09-16T15:02:30.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.358+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fedd7cc:::benchmark_data_smithi116_28801_object2855:head, will try copies on 3,4 2024-09-16T15:02:30.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.366+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:02:30.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 332 16 3626446 3626430 682.628 693.688 0.000651646 0.00145508 2024-09-16T15:02:30.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.402+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:02:30.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.402+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:02:30.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.422+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:256e8930:::benchmark_data_smithi116_28801_object60:head, will try copies on 0,4 2024-09-16T15:02:30.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db77c91:::benchmark_data_smithi116_28801_object2955:head, will try copies on 0,4 2024-09-16T15:02:30.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.454+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a451f7a:::benchmark_data_smithi116_28801_object3394:head, will try copies on 3,4 2024-09-16T15:02:30.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.458+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:02:30.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.478+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:02:30.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.494+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:02:30.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.502+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:02:30.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.506+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:02:30.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.510+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b0cc257:::benchmark_data_smithi116_28801_object754:head, will try copies on 0,4 2024-09-16T15:02:30.520 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.514+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:02:30.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.534+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:30.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.542+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:02:30.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.570+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:02:30.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.582+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:02:30.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.594+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:02:30.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.618+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:02:30.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.638+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:938c8f55:::benchmark_data_smithi116_28801_object999:head, will try copies on 0,4 2024-09-16T15:02:30.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.642+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:02:30.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.642+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T15:02:30.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.646+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:02:30.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.654+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d9a72a3:::benchmark_data_smithi116_28801_object635:head, will try copies on 3,4 2024-09-16T15:02:30.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.670+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:02:30.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.674+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:02:30.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.686+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:30.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.750+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:02:30.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.750+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8438e:::benchmark_data_smithi116_28801_object3043:head, will try copies on 2,3 2024-09-16T15:02:30.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.758+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:02:30.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.774+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:02:30.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.782+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:02:30.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.818+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255eab6b:::benchmark_data_smithi116_28801_object2846:head, will try copies on 0,4 2024-09-16T15:02:30.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.822+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:02:30.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.834+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:02:30.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.842+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:02:30.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.842+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T15:02:30.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.910+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:293e8b2f:::benchmark_data_smithi116_28801_object1232:head, will try copies on 0,4 2024-09-16T15:02:30.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.914+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:02:30.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.926+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:02:30.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.950+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:02:30.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.958+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T15:02:30.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.990+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:02:31.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:30.994+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:31.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.002+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:02:31.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.018+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:512b8d11:::benchmark_data_smithi116_28801_object1795:head, will try copies on 3,4 2024-09-16T15:02:31.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.022+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:02:31.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.058+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:02:31.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.074+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T15:02:31.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.082+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:02:31.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.090+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:02:31.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.094+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:02:31.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.098+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:02:31.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.130+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:02:31.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.162+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:02:31.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.166+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:02:31.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.174+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:02:31.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.214+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:02:31.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.214+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:02:31.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:02:31.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.246+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:02:31.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.250+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:02:31.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.262+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:31.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.338+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:02:31.358 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.354+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:02:31.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.354+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:02:31.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 333 16 3637427 3637411 682.639 686.312 0.00227264 0.00145506 2024-09-16T15:02:31.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.382+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:02:31.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.390+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23c7a0a7:::benchmark_data_smithi116_28801_object505:head, will try copies on 0,4 2024-09-16T15:02:31.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.406+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:02:31.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:02:31.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.438+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:02:31.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.450+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bcd6b0:::benchmark_data_smithi116_28801_object801:head, will try copies on 3,4 2024-09-16T15:02:31.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.486+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:02:31.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.498+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:02:31.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.510+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:02:31.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.510+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:02:31.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.514+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9388bf:::benchmark_data_smithi116_28801_object3563:head, will try copies on 0,4 2024-09-16T15:02:31.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.534+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:02:31.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.542+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:02:31.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.566+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:221bd371:::benchmark_data_smithi116_28801_object3873:head, will try copies on 0,4 2024-09-16T15:02:31.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.578+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dca28d:::benchmark_data_smithi116_28801_object3294:head, will try copies on 3,4 2024-09-16T15:02:31.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.594+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:02:31.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.622+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:02:31.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.622+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:02:31.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:02:31.654 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.650+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc485ca7:::benchmark_data_smithi116_28801_object237:head, will try copies on 2,3 2024-09-16T15:02:31.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.682+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:02:31.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.694+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:02:31.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.702+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:02:31.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.702+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a9a3db5:::benchmark_data_smithi116_28801_object2331:head, will try copies on 0,4 2024-09-16T15:02:31.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.722+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:02:31.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.734+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T15:02:31.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.738+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcea59d:::benchmark_data_smithi116_28801_object3613:head, will try copies on 0,4 2024-09-16T15:02:31.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.750+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba809e11:::benchmark_data_smithi116_28801_object3526:head, will try copies on 2,3 2024-09-16T15:02:31.776 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.770+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6638ccde:::benchmark_data_smithi116_28801_object2720:head, will try copies on 3,4 2024-09-16T15:02:31.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.778+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:02:31.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.810+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:02:31.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.834+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:02:31.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.834+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:02:31.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.838+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:02:31.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.850+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3e0986:::benchmark_data_smithi116_28801_object1770:head, will try copies on 2,3 2024-09-16T15:02:31.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.878+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T15:02:31.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.882+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:02:31.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.890+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:02:31.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.970+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:02:31.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:02:32.002 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:31.998+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6461d150:::benchmark_data_smithi116_28801_object3113:head, will try copies on 3,4 2024-09-16T15:02:32.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.034+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T15:02:32.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.062+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bd33dc4:::benchmark_data_smithi116_28801_object2049:head, will try copies on 0,4 2024-09-16T15:02:32.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.066+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:02:32.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.074+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:02:32.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.082+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:02:32.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.090+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:02:32.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.102+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce5039e:::benchmark_data_smithi116_28801_object3272:head, will try copies on 0,4 2024-09-16T15:02:32.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.118+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51eb041e:::benchmark_data_smithi116_28801_object2315:head, will try copies on 3,4 2024-09-16T15:02:32.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.130+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:02:32.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.134+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b9f062c:::benchmark_data_smithi116_28801_object3094:head, will try copies on 3,4 2024-09-16T15:02:32.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.150+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a44170:::benchmark_data_smithi116_28801_object3444:head, will try copies on 0,4 2024-09-16T15:02:32.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.166+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89ac692:::benchmark_data_smithi116_28801_object1522:head, will try copies on 2,3 2024-09-16T15:02:32.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.174+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:02:32.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.202+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95568a43:::benchmark_data_smithi116_28801_object2909:head, will try copies on 0,4 2024-09-16T15:02:32.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.222+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:02:32.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.234+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b94c86ca:::benchmark_data_smithi116_28801_object571:head, will try copies on 2,3 2024-09-16T15:02:32.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.250+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:02:32.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.262+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb9e9edd:::benchmark_data_smithi116_28801_object2616:head, will try copies on 2,3 2024-09-16T15:02:32.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.306+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:500323b4:::benchmark_data_smithi116_28801_object3242:head, will try copies on 3,4 2024-09-16T15:02:32.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.310+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:32.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.330+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:02:32.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.354+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56886627:::benchmark_data_smithi116_28801_object548:head, will try copies on 3,4 2024-09-16T15:02:32.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.370+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T15:02:32.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:02:32.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 334 16 3647991 3647975 682.572 660.25 0.00103906 0.00145521 2024-09-16T15:02:32.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.378+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:02:32.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.418+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:02:32.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:32.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.434+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da0c40c:::benchmark_data_smithi116_28801_object3536:head, will try copies on 0,4 2024-09-16T15:02:32.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:02:32.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T15:02:32.471 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.466+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:02:32.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.474+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3067a8:::benchmark_data_smithi116_28801_object2687:head, will try copies on 3,4 2024-09-16T15:02:32.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.478+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c98add:::benchmark_data_smithi116_28801_object197:head, will try copies on 0,4 2024-09-16T15:02:32.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.490+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:02:32.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.498+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:32.515 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.510+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:02:32.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:02:32.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.566+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:02:32.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.566+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T15:02:32.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.602+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:02:32.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.610+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:02:32.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.630+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:02:32.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.654+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:02:32.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.658+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:02:32.685 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.678+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99619959:::benchmark_data_smithi116_28801_object1780:head, will try copies on 0,4 2024-09-16T15:02:32.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.694+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:02:32.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.702+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:02:32.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.718+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:02:32.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.722+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:02:32.736 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.730+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:02:32.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.738+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95b86179:::benchmark_data_smithi116_28801_object1674:head, will try copies on 0,4 2024-09-16T15:02:32.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.754+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:02:32.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.758+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:02:32.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.766+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:02:32.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.786+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:02:32.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.798+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:02:32.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.834+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901aa146:::benchmark_data_smithi116_28801_object3510:head, will try copies on 0,4 2024-09-16T15:02:32.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.838+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:02:32.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.862+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521eee7c:::benchmark_data_smithi116_28801_object2296:head, will try copies on 3,4 2024-09-16T15:02:32.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.862+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:02:32.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.878+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:02:32.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.914+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:02:32.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.922+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:02:32.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.922+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:02:32.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.954+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:02:32.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.970+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f21e70a:::benchmark_data_smithi116_28801_object2265:head, will try copies on 3,4 2024-09-16T15:02:32.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.986+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:02:33.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:32.994+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:02:33.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.006+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:02:33.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.014+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:33.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.030+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:33.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.038+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:02:33.073 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.070+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:950c2d3b:::benchmark_data_smithi116_28801_object3457:head, will try copies on 0,4 2024-09-16T15:02:33.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.074+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86108bc:::benchmark_data_smithi116_28801_object1382:head, will try copies on 2,3 2024-09-16T15:02:33.103 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.098+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:02:33.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.102+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:02:33.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.130+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:02:33.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.130+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e73b73d:::benchmark_data_smithi116_28801_object4030:head, will try copies on 0,4 2024-09-16T15:02:33.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.154+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:02:33.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.166+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:02:33.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.182+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:02:33.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.186+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T15:02:33.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.202+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:02:33.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.214+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:02:33.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:02:33.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.226+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:02:33.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T15:02:33.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.258+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:02:33.267 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.262+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:02:33.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.286+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:02:33.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.302+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:02:33.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.302+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:02:33.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.318+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:02:33.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.370+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ce4ce6c:::benchmark_data_smithi116_28801_object1702:head, will try copies on 0,4 2024-09-16T15:02:33.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.374+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:02:33.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 335 16 3658999 3658983 682.588 688 0.00185269 0.00145518 2024-09-16T15:02:33.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.382+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6577cc68:::benchmark_data_smithi116_28801_object384:head, will try copies on 3,4 2024-09-16T15:02:33.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.402+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:02:33.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.418+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:02:33.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.418+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:02:33.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:02:33.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.442+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T15:02:33.459 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.454+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:02:33.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.474+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50f62ad:::benchmark_data_smithi116_28801_object1144:head, will try copies on 2,3 2024-09-16T15:02:33.487 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.482+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b35282:::benchmark_data_smithi116_28801_object724:head, will try copies on 3,4 2024-09-16T15:02:33.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.514+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:02:33.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.522+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T15:02:33.544 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.538+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:02:33.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.542+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T15:02:33.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.554+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:02:33.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.578+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:02:33.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.598+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:02:33.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.602+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:02:33.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.610+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:02:33.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.626+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T15:02:33.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.638+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:02:33.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.642+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:02:33.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.662+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52051509:::benchmark_data_smithi116_28801_object646:head, will try copies on 3,4 2024-09-16T15:02:33.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.682+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd6f77e:::benchmark_data_smithi116_28801_object2968:head, will try copies on 2,3 2024-09-16T15:02:33.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.690+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:02:33.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.694+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ca4587:::benchmark_data_smithi116_28801_object2749:head, will try copies on 3,4 2024-09-16T15:02:33.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.730+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:02:33.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.746+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:02:33.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.762+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:02:33.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.762+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:02:33.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.822+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:02:33.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.834+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:02:33.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.858+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:02:33.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.878+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2268a4f0:::benchmark_data_smithi116_28801_object2257:head, will try copies on 0,4 2024-09-16T15:02:33.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.882+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:02:33.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.890+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:02:33.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.898+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c541afa:::benchmark_data_smithi116_28801_object2446:head, will try copies on 3,4 2024-09-16T15:02:33.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.930+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22cee93c:::benchmark_data_smithi116_28801_object3378:head, will try copies on 0,4 2024-09-16T15:02:33.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.934+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:02:33.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:02:33.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.958+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:02:33.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:255d4dfd:::benchmark_data_smithi116_28801_object4022:head, will try copies on 0,4 2024-09-16T15:02:33.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:33.994+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:02:34.011 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.006+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:02:34.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.030+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:02:34.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.038+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:34.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.042+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:02:34.051 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.046+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:02:34.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.058+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:34.084 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.078+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:02:34.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.098+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a71b48:::benchmark_data_smithi116_28801_object632:head, will try copies on 0,4 2024-09-16T15:02:34.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.122+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:02:34.129 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.126+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:02:34.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.134+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:02:34.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.158+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:02:34.167 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.162+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f0474ce:::benchmark_data_smithi116_28801_object3465:head, will try copies on 0,4 2024-09-16T15:02:34.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.194+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:02:34.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.222+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:34.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:288e8c79:::benchmark_data_smithi116_28801_object3685:head, will try copies on 0,4 2024-09-16T15:02:34.235 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.230+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695cd389:::benchmark_data_smithi116_28801_object3582:head, will try copies on 3,4 2024-09-16T15:02:34.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.250+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:02:34.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.254+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9204c90a:::benchmark_data_smithi116_28801_object85:head, will try copies on 0,4 2024-09-16T15:02:34.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.278+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c148635:::benchmark_data_smithi116_28801_object2975:head, will try copies on 0,4 2024-09-16T15:02:34.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.286+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:02:34.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.302+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:02:34.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.326+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf13f60:::benchmark_data_smithi116_28801_object870:head, will try copies on 0,4 2024-09-16T15:02:34.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.346+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:02:34.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.358+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:02:34.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.362+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:34.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.370+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:02:34.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.374+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:02:34.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 336 15 3669849 3669834 682.574 678.188 0.00102271 0.0014552 2024-09-16T15:02:34.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.386+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:02:34.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.398+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ace7cbc:::benchmark_data_smithi116_28801_object1852:head, will try copies on 0,4 2024-09-16T15:02:34.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.422+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:02:34.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.434+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:02:34.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.438+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:02:34.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.470+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T15:02:34.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.486+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59343bbf:::benchmark_data_smithi116_28801_object1446:head, will try copies on 3,4 2024-09-16T15:02:34.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.506+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:02:34.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.518+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998a43a6:::benchmark_data_smithi116_28801_object913:head, will try copies on 0,4 2024-09-16T15:02:34.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.542+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:02:34.561 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.558+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:02:34.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.566+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:02:34.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.578+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:02:34.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.590+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T15:02:34.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.598+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:02:34.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.642+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T15:02:34.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.658+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:34.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.662+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:02:34.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.674+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:02:34.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.702+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:34.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.706+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T15:02:34.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.718+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:02:34.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.718+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:02:34.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.726+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:02:34.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.738+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:02:34.766 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.762+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:02:34.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.774+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:02:34.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.834+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:02:34.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.834+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:02:34.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.854+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:02:34.871 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.866+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:34.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.878+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc154017:::benchmark_data_smithi116_28801_object1203:head, will try copies on 2,3 2024-09-16T15:02:34.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.906+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:02:34.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.910+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:02:34.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.930+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:02:34.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.954+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:02:34.960 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.954+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5358e3e7:::benchmark_data_smithi116_28801_object915:head, will try copies on 3,4 2024-09-16T15:02:34.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:34.990+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:02:35.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.002+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:02:35.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.010+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:02:35.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.026+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:02:35.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.050+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:02:35.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.062+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:02:35.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.074+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ff13d0:::benchmark_data_smithi116_28801_object3916:head, will try copies on 3,4 2024-09-16T15:02:35.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.086+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:02:35.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.106+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T15:02:35.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.114+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:02:35.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.118+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:02:35.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.126+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T15:02:35.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.154+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:02:35.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.162+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614d7386:::benchmark_data_smithi116_28801_object1397:head, will try copies on 3,4 2024-09-16T15:02:35.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.182+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:02:35.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.186+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:02:35.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.230+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827999d:::benchmark_data_smithi116_28801_object2326:head, will try copies on 0,4 2024-09-16T15:02:35.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.234+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:02:35.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.250+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T15:02:35.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.270+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a32c6e1:::benchmark_data_smithi116_28801_object684:head, will try copies on 3,4 2024-09-16T15:02:35.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.270+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:02:35.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.286+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:02:35.310 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.306+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232e4554:::benchmark_data_smithi116_28801_object3116:head, will try copies on 0,4 2024-09-16T15:02:35.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.306+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T15:02:35.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.326+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:02:35.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.334+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:02:35.363 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.358+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:02:35.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.374+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:02:35.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 337 16 3681147 3681131 682.644 706.062 0.00114173 0.00145506 2024-09-16T15:02:35.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.382+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:02:35.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.386+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:02:35.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.394+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c208e3a:::benchmark_data_smithi116_28801_object2:head, will try copies on 3,4 2024-09-16T15:02:35.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:02:35.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:02:35.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.446+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:02:35.452 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.446+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:02:35.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.458+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:02:35.489 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.486+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:02:35.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:02:35.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.506+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:02:35.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:02:35.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:02:35.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.546+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:02:35.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.554+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:02:35.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.558+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:02:35.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.578+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:02:35.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.606+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:02:35.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.606+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:02:35.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.606+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:02:35.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.610+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T15:02:35.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.622+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:02:35.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.658+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:02:35.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.686+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:02:35.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.710+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:02:35.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.726+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:02:35.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.734+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904d1d2b:::benchmark_data_smithi116_28801_object3240:head, will try copies on 0,4 2024-09-16T15:02:35.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.746+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:02:35.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.778+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T15:02:35.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.782+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fee761b:::benchmark_data_smithi116_28801_object2305:head, will try copies on 0,4 2024-09-16T15:02:35.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.810+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:02:35.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.846+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6781cba2:::benchmark_data_smithi116_28801_object1595:head, will try copies on 3,4 2024-09-16T15:02:35.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.846+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:02:35.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.850+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:02:35.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.870+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ce14dc:::benchmark_data_smithi116_28801_object2672:head, will try copies on 2,3 2024-09-16T15:02:35.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.886+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:02:35.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:35.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.894+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9bd798:::benchmark_data_smithi116_28801_object2913:head, will try copies on 3,4 2024-09-16T15:02:35.904 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.898+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b57d75eb:::benchmark_data_smithi116_28801_object2215:head, will try copies on 2,3 2024-09-16T15:02:35.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.922+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:02:35.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.934+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9058c09d:::benchmark_data_smithi116_28801_object869:head, will try copies on 0,4 2024-09-16T15:02:35.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.954+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:02:35.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.962+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:02:35.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.974+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b69174d4:::benchmark_data_smithi116_28801_object243:head, will try copies on 2,3 2024-09-16T15:02:35.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.982+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:02:35.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:35.986+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:02:36.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.014+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:02:36.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.026+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9ed09a:::benchmark_data_smithi116_28801_object1546:head, will try copies on 3,4 2024-09-16T15:02:36.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.058+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:02:36.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.074+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:02:36.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.074+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6915932e:::benchmark_data_smithi116_28801_object3854:head, will try copies on 3,4 2024-09-16T15:02:36.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.082+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:02:36.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.094+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a868977:::benchmark_data_smithi116_28801_object325:head, will try copies on 3,4 2024-09-16T15:02:36.101 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.098+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T15:02:36.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.106+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c505242:::benchmark_data_smithi116_28801_object2141:head, will try copies on 0,4 2024-09-16T15:02:36.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.142+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:36.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.154+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:02:36.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.182+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:02:36.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.194+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c13506d:::benchmark_data_smithi116_28801_object589:head, will try copies on 0,4 2024-09-16T15:02:36.202 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.198+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:02:36.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.202+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:02:36.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.230+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T15:02:36.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:02:36.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.254+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:02:36.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.254+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T15:02:36.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.266+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:02:36.306 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.302+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8c1c6b:::benchmark_data_smithi116_28801_object3164:head, will try copies on 2,3 2024-09-16T15:02:36.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.310+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:02:36.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.314+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506181b7:::benchmark_data_smithi116_28801_object3237:head, will try copies on 3,4 2024-09-16T15:02:36.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.322+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24338d66:::benchmark_data_smithi116_28801_object3647:head, will try copies on 0,4 2024-09-16T15:02:36.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.354+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:02:36.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.366+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:609e1637:::benchmark_data_smithi116_28801_object3864:head, will try copies on 3,4 2024-09-16T15:02:36.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.366+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:02:36.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.374+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:02:36.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 338 16 3692017 3692001 682.634 679.375 0.000721689 0.00145507 2024-09-16T15:02:36.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.414+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a094916:::benchmark_data_smithi116_28801_object1393:head, will try copies on 3,4 2024-09-16T15:02:36.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.434+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:02:36.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.438+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:02:36.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.486+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:02:36.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.498+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:02:36.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.502+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:02:36.513 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.510+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:02:36.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.538+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7486503:::benchmark_data_smithi116_28801_object3227:head, will try copies on 2,3 2024-09-16T15:02:36.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.542+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:02:36.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.554+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:02:36.567 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.562+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98473f76:::benchmark_data_smithi116_28801_object4059:head, will try copies on 0,4 2024-09-16T15:02:36.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.598+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:36.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.606+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:02:36.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.610+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:36.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.622+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:02:36.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.622+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:02:36.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.658+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d3dd4bb:::benchmark_data_smithi116_28801_object2552:head, will try copies on 3,4 2024-09-16T15:02:36.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.662+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:02:36.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.674+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:02:36.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.694+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:02:36.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.694+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:02:36.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.706+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:02:36.718 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.714+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ed3adf:::benchmark_data_smithi116_28801_object3208:head, will try copies on 3,4 2024-09-16T15:02:36.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.722+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:02:36.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.738+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262f69e2:::benchmark_data_smithi116_28801_object562:head, will try copies on 0,4 2024-09-16T15:02:36.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.750+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:02:36.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.770+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:02:36.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.802+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:506358c4:::benchmark_data_smithi116_28801_object1375:head, will try copies on 3,4 2024-09-16T15:02:36.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.810+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T15:02:36.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.822+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:02:36.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.830+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3a70b2:::benchmark_data_smithi116_28801_object1790:head, will try copies on 2,3 2024-09-16T15:02:36.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.850+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62de5d23:::benchmark_data_smithi116_28801_object2972:head, will try copies on 3,4 2024-09-16T15:02:36.867 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.862+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:02:36.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.870+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T15:02:36.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.886+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:287e674f:::benchmark_data_smithi116_28801_object2312:head, will try copies on 0,4 2024-09-16T15:02:36.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.950+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:02:36.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.970+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5d5a71:::benchmark_data_smithi116_28801_object3225:head, will try copies on 2,3 2024-09-16T15:02:36.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.978+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:02:36.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:02:36.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.990+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b78db38:::benchmark_data_smithi116_28801_object3768:head, will try copies on 3,4 2024-09-16T15:02:37.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:36.998+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becec8cb:::benchmark_data_smithi116_28801_object1638:head, will try copies on 2,3 2024-09-16T15:02:37.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.062+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:37.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.074+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe21625:::benchmark_data_smithi116_28801_object22:head, will try copies on 0,4 2024-09-16T15:02:37.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.102+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:02:37.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.102+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be6eb3bc:::benchmark_data_smithi116_28801_object3813:head, will try copies on 2,3 2024-09-16T15:02:37.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.126+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27afca70:::benchmark_data_smithi116_28801_object655:head, will try copies on 0,4 2024-09-16T15:02:37.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.138+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1236de7:::benchmark_data_smithi116_28801_object3745:head, will try copies on 2,3 2024-09-16T15:02:37.151 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.146+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:02:37.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.166+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5224c72e:::benchmark_data_smithi116_28801_object2152:head, will try copies on 3,4 2024-09-16T15:02:37.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.198+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:02:37.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.222+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5832b7f4:::benchmark_data_smithi116_28801_object1148:head, will try copies on 3,4 2024-09-16T15:02:37.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.238+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:02:37.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.242+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96183aaf:::benchmark_data_smithi116_28801_object761:head, will try copies on 0,4 2024-09-16T15:02:37.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.250+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:02:37.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.254+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:02:37.261 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.258+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f040a16:::benchmark_data_smithi116_28801_object3742:head, will try copies on 3,4 2024-09-16T15:02:37.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.290+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96eeb87d:::benchmark_data_smithi116_28801_object2667:head, will try copies on 0,4 2024-09-16T15:02:37.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.290+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:02:37.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.302+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606d110e:::benchmark_data_smithi116_28801_object2608:head, will try copies on 3,4 2024-09-16T15:02:37.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.314+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29887728:::benchmark_data_smithi116_28801_object1969:head, will try copies on 0,4 2024-09-16T15:02:37.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.350+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:02:37.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.370+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:37.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 339 16 3702803 3702787 682.609 674.125 0.00523928 0.00145513 2024-09-16T15:02:37.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.378+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5ec395:::benchmark_data_smithi116_28801_object2185:head, will try copies on 2,3 2024-09-16T15:02:37.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.382+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93755ab9:::benchmark_data_smithi116_28801_object1779:head, will try copies on 0,4 2024-09-16T15:02:37.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.422+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2942c247:::benchmark_data_smithi116_28801_object1971:head, will try copies on 0,4 2024-09-16T15:02:37.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.470+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:02:37.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.474+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:02:37.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.526+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1eca818:::benchmark_data_smithi116_28801_object394:head, will try copies on 2,3 2024-09-16T15:02:37.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.554+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21a283fc:::benchmark_data_smithi116_28801_object1757:head, will try copies on 0,4 2024-09-16T15:02:37.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.574+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:02:37.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.574+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:02:37.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.602+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:02:37.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.606+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:02:37.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.622+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bed2c1c5:::benchmark_data_smithi116_28801_object852:head, will try copies on 2,3 2024-09-16T15:02:37.632 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.626+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:02:37.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.630+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:02:37.660 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.654+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:02:37.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.666+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:02:37.675 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.670+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:02:37.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.678+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:02:37.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.698+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2590a1:::benchmark_data_smithi116_28801_object1527:head, will try copies on 2,3 2024-09-16T15:02:37.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.722+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ec824f6:::benchmark_data_smithi116_28801_object633:head, will try copies on 3,4 2024-09-16T15:02:37.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.734+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53831f6e:::benchmark_data_smithi116_28801_object1958:head, will try copies on 3,4 2024-09-16T15:02:37.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.754+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:02:37.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.766+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:02:37.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.778+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:02:37.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.786+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:02:37.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.798+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23918458:::benchmark_data_smithi116_28801_object2633:head, will try copies on 0,4 2024-09-16T15:02:37.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.830+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:02:37.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.838+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e2bcc31:::benchmark_data_smithi116_28801_object3708:head, will try copies on 3,4 2024-09-16T15:02:37.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.838+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f67fdf:::benchmark_data_smithi116_28801_object46:head, will try copies on 0,4 2024-09-16T15:02:37.847 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.842+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b229d9b0:::benchmark_data_smithi116_28801_object4095:head, will try copies on 2,3 2024-09-16T15:02:37.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:02:37.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.854+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:02:37.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.870+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:02:37.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.882+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939d7901:::benchmark_data_smithi116_28801_object1327:head, will try copies on 0,4 2024-09-16T15:02:37.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.906+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2036d69c:::benchmark_data_smithi116_28801_object3930:head, will try copies on 0,4 2024-09-16T15:02:37.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.910+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:02:37.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.922+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e84cce:::benchmark_data_smithi116_28801_object2198:head, will try copies on 3,4 2024-09-16T15:02:37.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.942+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ac09234:::benchmark_data_smithi116_28801_object946:head, will try copies on 0,4 2024-09-16T15:02:37.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:37.982+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fc69c9e:::benchmark_data_smithi116_28801_object3842:head, will try copies on 0,4 2024-09-16T15:02:38.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.002+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d910dd:::benchmark_data_smithi116_28801_object2318:head, will try copies on 3,4 2024-09-16T15:02:38.010 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.006+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b16d8981:::benchmark_data_smithi116_28801_object2842:head, will try copies on 2,3 2024-09-16T15:02:38.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.034+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e0ac77:::benchmark_data_smithi116_28801_object3050:head, will try copies on 2,3 2024-09-16T15:02:38.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.038+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229f48a3:::benchmark_data_smithi116_28801_object997:head, will try copies on 0,4 2024-09-16T15:02:38.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.042+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:02:38.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.054+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:02:38.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.062+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3d1b46:::benchmark_data_smithi116_28801_object2278:head, will try copies on 0,4 2024-09-16T15:02:38.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.102+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d68c5b:::benchmark_data_smithi116_28801_object1837:head, will try copies on 2,3 2024-09-16T15:02:38.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.110+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:663b0e56:::benchmark_data_smithi116_28801_object3487:head, will try copies on 3,4 2024-09-16T15:02:38.116 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.110+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:02:38.137 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.134+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60ddaeab:::benchmark_data_smithi116_28801_object2953:head, will try copies on 3,4 2024-09-16T15:02:38.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.142+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:02:38.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.142+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T15:02:38.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.150+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:02:38.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.166+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd6d655:::benchmark_data_smithi116_28801_object1705:head, will try copies on 3,4 2024-09-16T15:02:38.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.166+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bb9a30:::benchmark_data_smithi116_28801_object3327:head, will try copies on 3,4 2024-09-16T15:02:38.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.226+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22c211d9:::benchmark_data_smithi116_28801_object1250:head, will try copies on 0,4 2024-09-16T15:02:38.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.230+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T15:02:38.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.238+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:02:38.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.250+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:02:38.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.254+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd932cb1:::benchmark_data_smithi116_28801_object3617:head, will try copies on 2,3 2024-09-16T15:02:38.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.262+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:02:38.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.278+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:02:38.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.282+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:02:38.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:02:38.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.322+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:02:38.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.346+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef99a13:::benchmark_data_smithi116_28801_object44:head, will try copies on 3,4 2024-09-16T15:02:38.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.350+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T15:02:38.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.354+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:02:38.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:2024-09-16T15:02:38.384638+0000 min lat: 0.000210839 max lat: 0.16813 avg lat: 0.00145544 2024-09-16T15:02:38.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T15:02:38.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 340 16 3712938 3712922 682.464 633.438 0.00138678 0.00145544 2024-09-16T15:02:38.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.382+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:02:38.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.398+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2199fd:::benchmark_data_smithi116_28801_object1313:head, will try copies on 3,4 2024-09-16T15:02:38.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.398+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:02:38.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.454+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:02:38.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.474+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:02:38.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.486+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:02:38.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.498+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd832af4:::benchmark_data_smithi116_28801_object2413:head, will try copies on 2,3 2024-09-16T15:02:38.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.522+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:550efe76:::benchmark_data_smithi116_28801_object2645:head, will try copies on 3,4 2024-09-16T15:02:38.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.526+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:02:38.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.534+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:02:38.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.546+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:02:38.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.578+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:02:38.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.578+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68affe4c:::benchmark_data_smithi116_28801_object2688:head, will try copies on 3,4 2024-09-16T15:02:38.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.586+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:02:38.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.586+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:02:38.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.598+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:02:38.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.606+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:38.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.618+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:02:38.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.618+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b17b5014:::benchmark_data_smithi116_28801_object3658:head, will try copies on 2,3 2024-09-16T15:02:38.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.682+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T15:02:38.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.686+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T15:02:38.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.694+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90551121:::benchmark_data_smithi116_28801_object2488:head, will try copies on 0,4 2024-09-16T15:02:38.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.718+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:02:38.732 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.726+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:02:38.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.758+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:02:38.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.758+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:02:38.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.774+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e87df7a:::benchmark_data_smithi116_28801_object216:head, will try copies on 0,4 2024-09-16T15:02:38.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.806+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:02:38.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.806+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:02:38.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.810+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:02:38.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.822+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:02:38.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.874+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:02:38.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.890+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a3be56:::benchmark_data_smithi116_28801_object1196:head, will try copies on 3,4 2024-09-16T15:02:38.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.890+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7fffffb:::benchmark_data_smithi116_28801_object3380:head, will try copies on 2,3 2024-09-16T15:02:38.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.906+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:02:38.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.934+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:02:38.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.946+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c70dc6:::benchmark_data_smithi116_28801_object2086:head, will try copies on 0,4 2024-09-16T15:02:38.954 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.950+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2929111e:::benchmark_data_smithi116_28801_object2229:head, will try copies on 0,4 2024-09-16T15:02:38.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.950+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86591:::benchmark_data_smithi116_28801_object2875:head, will try copies on 2,3 2024-09-16T15:02:38.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.954+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:02:38.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.982+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:02:39.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:38.998+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:02:39.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.002+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:39.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.014+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c09accd:::benchmark_data_smithi116_28801_object1709:head, will try copies on 3,4 2024-09-16T15:02:39.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.022+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:02:39.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.034+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:02:39.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.042+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:02:39.052 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.046+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:02:39.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.074+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:02:39.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.086+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb6b3a1:::benchmark_data_smithi116_28801_object1700:head, will try copies on 0,4 2024-09-16T15:02:39.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.086+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5731a9ed:::benchmark_data_smithi116_28801_object2915:head, will try copies on 3,4 2024-09-16T15:02:39.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.094+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:02:39.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.106+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:02:39.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.126+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:02:39.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.142+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c32f49:::benchmark_data_smithi116_28801_object1410:head, will try copies on 3,4 2024-09-16T15:02:39.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.154+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:02:39.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.186+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6152681a:::benchmark_data_smithi116_28801_object3316:head, will try copies on 3,4 2024-09-16T15:02:39.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.186+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f333ccc:::benchmark_data_smithi116_28801_object3801:head, will try copies on 0,4 2024-09-16T15:02:39.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.226+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5264d418:::benchmark_data_smithi116_28801_object1718:head, will try copies on 3,4 2024-09-16T15:02:39.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.230+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:02:39.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.242+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:39.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.250+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ce1b37:::benchmark_data_smithi116_28801_object472:head, will try copies on 3,4 2024-09-16T15:02:39.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.258+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d90a63b:::benchmark_data_smithi116_28801_object766:head, will try copies on 0,4 2024-09-16T15:02:39.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.262+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T15:02:39.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.266+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:02:39.336 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.330+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:39.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.338+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:02:39.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.358+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:02:39.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.362+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T15:02:39.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.370+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:02:39.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.374+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be2fba09:::benchmark_data_smithi116_28801_object3945:head, will try copies on 2,3 2024-09-16T15:02:39.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 341 16 3723807 3723791 682.455 679.312 0.000870681 0.00145545 2024-09-16T15:02:39.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.394+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:39.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.398+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629b5384:::benchmark_data_smithi116_28801_object3622:head, will try copies on 3,4 2024-09-16T15:02:39.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96adcf1e:::benchmark_data_smithi116_28801_object2005:head, will try copies on 0,4 2024-09-16T15:02:39.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.438+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:02:39.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.442+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62fc137e:::benchmark_data_smithi116_28801_object636:head, will try copies on 3,4 2024-09-16T15:02:39.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.470+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:02:39.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.474+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b391dbc:::benchmark_data_smithi116_28801_object1383:head, will try copies on 3,4 2024-09-16T15:02:39.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.490+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T15:02:39.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.502+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a628a7f:::benchmark_data_smithi116_28801_object1488:head, will try copies on 3,4 2024-09-16T15:02:39.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.502+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:02:39.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:02:39.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.542+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:02:39.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.574+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:02:39.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.574+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64b16:::benchmark_data_smithi116_28801_object3762:head, will try copies on 0,4 2024-09-16T15:02:39.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.590+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:39.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.610+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:02:39.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.642+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:02:39.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.642+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d06ca4e:::benchmark_data_smithi116_28801_object2489:head, will try copies on 3,4 2024-09-16T15:02:39.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.658+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d998ccb:::benchmark_data_smithi116_28801_object4103:head, will try copies on 0,4 2024-09-16T15:02:39.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.686+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T15:02:39.720 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.714+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:274d4c97:::benchmark_data_smithi116_28801_object1919:head, will try copies on 0,4 2024-09-16T15:02:39.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.722+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:02:39.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.746+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986ec84b:::benchmark_data_smithi116_28801_object1826:head, will try copies on 0,4 2024-09-16T15:02:39.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.746+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:02:39.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.746+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:39.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.754+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:39.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.798+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:02:39.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.798+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae36e20:::benchmark_data_smithi116_28801_object1:head, will try copies on 0,4 2024-09-16T15:02:39.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.818+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:02:39.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.818+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:02:39.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.838+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f504fd:::benchmark_data_smithi116_28801_object3160:head, will try copies on 0,4 2024-09-16T15:02:39.864 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.858+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93624c37:::benchmark_data_smithi116_28801_object2203:head, will try copies on 0,4 2024-09-16T15:02:39.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.890+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:02:39.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.906+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b555ebf2:::benchmark_data_smithi116_28801_object2370:head, will try copies on 2,3 2024-09-16T15:02:39.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.926+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:02:39.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.926+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b659711:::benchmark_data_smithi116_28801_object3669:head, will try copies on 3,4 2024-09-16T15:02:39.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:02:39.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.954+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:02:39.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.970+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:02:39.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.974+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9e5045:::benchmark_data_smithi116_28801_object2442:head, will try copies on 3,4 2024-09-16T15:02:39.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:02:39.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.982+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:02:40.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:39.994+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4deae3:::benchmark_data_smithi116_28801_object1372:head, will try copies on 0,4 2024-09-16T15:02:40.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.022+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3b882bf:::benchmark_data_smithi116_28801_object2194:head, will try copies on 2,3 2024-09-16T15:02:40.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.034+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f5f8d25:::benchmark_data_smithi116_28801_object888:head, will try copies on 3,4 2024-09-16T15:02:40.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.038+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d70e76:::benchmark_data_smithi116_28801_object3053:head, will try copies on 0,4 2024-09-16T15:02:40.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.050+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:02:40.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.054+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68313bdc:::benchmark_data_smithi116_28801_object455:head, will try copies on 3,4 2024-09-16T15:02:40.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.066+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5acef0e9:::benchmark_data_smithi116_28801_object2023:head, will try copies on 3,4 2024-09-16T15:02:40.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.130+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:02:40.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.134+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T15:02:40.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.154+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:530b94a3:::benchmark_data_smithi116_28801_object2997:head, will try copies on 3,4 2024-09-16T15:02:40.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.186+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:02:40.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.190+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5abb12b7:::benchmark_data_smithi116_28801_object2995:head, will try copies on 3,4 2024-09-16T15:02:40.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.190+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:02:40.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.226+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad72f9e:::benchmark_data_smithi116_28801_object1166:head, will try copies on 0,4 2024-09-16T15:02:40.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.230+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:02:40.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.234+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:02:40.241 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.238+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:02:40.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.246+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:02:40.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.290+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:02:40.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.310+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:02:40.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.314+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:02:40.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.326+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:02:40.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.326+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:02:40.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.330+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:02:40.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.350+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb28727c:::benchmark_data_smithi116_28801_object3349:head, will try copies on 2,3 2024-09-16T15:02:40.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.366+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:02:40.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.370+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:229e5d27:::benchmark_data_smithi116_28801_object760:head, will try copies on 0,4 2024-09-16T15:02:40.383 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 342 16 3734654 3734638 682.441 677.938 0.0010857 0.00145547 2024-09-16T15:02:40.387 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.382+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:02:40.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.422+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad1f102:::benchmark_data_smithi116_28801_object3413:head, will try copies on 0,4 2024-09-16T15:02:40.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.434+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:02:40.447 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.442+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb62f5f:::benchmark_data_smithi116_28801_object1581:head, will try copies on 0,4 2024-09-16T15:02:40.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62ecd07e:::benchmark_data_smithi116_28801_object449:head, will try copies on 3,4 2024-09-16T15:02:40.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.490+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:02:40.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.502+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:40.533 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.526+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:02:40.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.546+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:02:40.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.546+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82eb4a2:::benchmark_data_smithi116_28801_object1344:head, will try copies on 2,3 2024-09-16T15:02:40.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.570+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb0fe3:::benchmark_data_smithi116_28801_object1373:head, will try copies on 3,4 2024-09-16T15:02:40.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.570+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:02:40.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.590+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:02:40.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.606+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:02:40.614 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.610+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:02:40.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.622+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:02:40.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.634+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:02:40.656 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.650+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:02:40.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.662+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:02:40.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.686+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf688b77:::benchmark_data_smithi116_28801_object927:head, will try copies on 2,3 2024-09-16T15:02:40.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.690+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e79cd7:::benchmark_data_smithi116_28801_object2173:head, will try copies on 3,4 2024-09-16T15:02:40.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.706+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f019d73:::benchmark_data_smithi116_28801_object837:head, will try copies on 0,4 2024-09-16T15:02:40.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.710+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:02:40.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.738+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:219c5c1f:::benchmark_data_smithi116_28801_object2342:head, will try copies on 0,4 2024-09-16T15:02:40.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.742+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:02:40.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.746+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8eeaa81:::benchmark_data_smithi116_28801_object1386:head, will try copies on 2,3 2024-09-16T15:02:40.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.754+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:02:40.760 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.754+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:02:40.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.794+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T15:02:40.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.806+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b15d50c8:::benchmark_data_smithi116_28801_object1388:head, will try copies on 2,3 2024-09-16T15:02:40.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.818+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:02:40.838 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.834+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:02:40.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.842+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0271893:::benchmark_data_smithi116_28801_object2783:head, will try copies on 2,3 2024-09-16T15:02:40.889 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.886+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d25a4e1:::benchmark_data_smithi116_28801_object167:head, will try copies on 3,4 2024-09-16T15:02:40.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.886+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62484fd7:::benchmark_data_smithi116_28801_object1762:head, will try copies on 3,4 2024-09-16T15:02:40.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.902+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:40.906 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.902+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9314c377:::benchmark_data_smithi116_28801_object880:head, will try copies on 0,4 2024-09-16T15:02:40.912 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.906+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:02:40.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.910+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:02:40.958 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.954+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:02:40.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.962+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:02:40.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:40.974+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:02:41.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.002+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:02:41.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.006+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8982b8:::benchmark_data_smithi116_28801_object1663:head, will try copies on 0,4 2024-09-16T15:02:41.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.010+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c5b044:::benchmark_data_smithi116_28801_object2770:head, will try copies on 0,4 2024-09-16T15:02:41.020 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.014+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd8c78b:::benchmark_data_smithi116_28801_object3812:head, will try copies on 3,4 2024-09-16T15:02:41.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.030+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c3c91ca:::benchmark_data_smithi116_28801_object3732:head, will try copies on 0,4 2024-09-16T15:02:41.056 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.050+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:02:41.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.066+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:02:41.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.102+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:02:41.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.102+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97c7e50d:::benchmark_data_smithi116_28801_object2022:head, will try copies on 0,4 2024-09-16T15:02:41.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.114+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:02:41.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.130+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8016dd3:::benchmark_data_smithi116_28801_object2763:head, will try copies on 2,3 2024-09-16T15:02:41.145 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.142+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56c1d54a:::benchmark_data_smithi116_28801_object985:head, will try copies on 3,4 2024-09-16T15:02:41.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.166+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:648f7c00:::benchmark_data_smithi116_28801_object2888:head, will try copies on 3,4 2024-09-16T15:02:41.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.170+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23de0f6b:::benchmark_data_smithi116_28801_object3462:head, will try copies on 0,4 2024-09-16T15:02:41.185 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.182+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:02:41.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.218+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215c7d2e:::benchmark_data_smithi116_28801_object526:head, will try copies on 0,4 2024-09-16T15:02:41.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.238+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc570277:::benchmark_data_smithi116_28801_object1636:head, will try copies on 2,3 2024-09-16T15:02:41.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.242+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T15:02:41.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.274+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be74b2d:::benchmark_data_smithi116_28801_object2242:head, will try copies on 3,4 2024-09-16T15:02:41.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.290+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:02:41.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.294+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:02:41.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.306+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b9d322b:::benchmark_data_smithi116_28801_object1956:head, will try copies on 3,4 2024-09-16T15:02:41.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.334+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:02:41.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.338+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d1114:::benchmark_data_smithi116_28801_object1075:head, will try copies on 2,3 2024-09-16T15:02:41.349 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.346+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eaf3ad6:::benchmark_data_smithi116_28801_object621:head, will try copies on 0,4 2024-09-16T15:02:41.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.354+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d21c6e7:::benchmark_data_smithi116_28801_object1517:head, will try copies on 0,4 2024-09-16T15:02:41.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 343 16 3745793 3745777 682.481 696.188 0.000743021 0.0014554 2024-09-16T15:02:41.419 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.414+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:41.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.418+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:02:41.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.430+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:41.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.430+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:02:41.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.446+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e712696:::benchmark_data_smithi116_28801_object27:head, will try copies on 0,4 2024-09-16T15:02:41.466 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.462+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:02:41.510 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.506+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b91e97e:::benchmark_data_smithi116_28801_object920:head, will try copies on 0,4 2024-09-16T15:02:41.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.506+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:02:41.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.514+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:02:41.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.542+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:02:41.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.550+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:02:41.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.598+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ae0ff9:::benchmark_data_smithi116_28801_object1041:head, will try copies on 3,4 2024-09-16T15:02:41.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.614+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:02:41.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.618+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:02:41.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.642+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f94515c:::benchmark_data_smithi116_28801_object3096:head, will try copies on 3,4 2024-09-16T15:02:41.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.646+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:02:41.677 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.674+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba3cf5c3:::benchmark_data_smithi116_28801_object890:head, will try copies on 2,3 2024-09-16T15:02:41.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.678+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902a1151:::benchmark_data_smithi116_28801_object1949:head, will try copies on 0,4 2024-09-16T15:02:41.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.686+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:02:41.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.726+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad5bf84:::benchmark_data_smithi116_28801_object3855:head, will try copies on 0,4 2024-09-16T15:02:41.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.734+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:02:41.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.734+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d010de5:::benchmark_data_smithi116_28801_object2839:head, will try copies on 0,4 2024-09-16T15:02:41.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.766+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b20dd4:::benchmark_data_smithi116_28801_object508:head, will try copies on 0,4 2024-09-16T15:02:41.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.766+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b70e69df:::benchmark_data_smithi116_28801_object2890:head, will try copies on 2,3 2024-09-16T15:02:41.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.782+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:02:41.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.794+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676dc212:::benchmark_data_smithi116_28801_object703:head, will try copies on 3,4 2024-09-16T15:02:41.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.806+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b757f02:::benchmark_data_smithi116_28801_object2549:head, will try copies on 0,4 2024-09-16T15:02:41.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.818+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23144949:::benchmark_data_smithi116_28801_object403:head, will try copies on 0,4 2024-09-16T15:02:41.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.830+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:02:41.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.842+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:02:41.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.874+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:02:41.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.886+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:02:41.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.922+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:02:41.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:02:41.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.946+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:41.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.966+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:41.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:02:41.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.986+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:02:41.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:02:42.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.994+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:02:42.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:41.994+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f238a72:::benchmark_data_smithi116_28801_object2367:head, will try copies on 3,4 2024-09-16T15:02:42.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.026+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:02:42.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.058+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:02:42.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.058+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6386cef2:::benchmark_data_smithi116_28801_object1760:head, will try copies on 3,4 2024-09-16T15:02:42.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.066+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8598b15:::benchmark_data_smithi116_28801_object1073:head, will try copies on 2,3 2024-09-16T15:02:42.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.082+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:02:42.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.102+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9377e680:::benchmark_data_smithi116_28801_object1199:head, will try copies on 0,4 2024-09-16T15:02:42.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.142+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbaff9c6:::benchmark_data_smithi116_28801_object2351:head, will try copies on 2,3 2024-09-16T15:02:42.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.162+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d806de4:::benchmark_data_smithi116_28801_object1717:head, will try copies on 0,4 2024-09-16T15:02:42.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.174+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:42.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.190+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:02:42.201 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.194+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:02:42.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.202+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:02:42.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.246+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:42.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b74167e2:::benchmark_data_smithi116_28801_object3969:head, will try copies on 2,3 2024-09-16T15:02:42.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.262+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:42.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.278+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T15:02:42.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62bcee67:::benchmark_data_smithi116_28801_object3156:head, will try copies on 3,4 2024-09-16T15:02:42.298 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.294+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef9039e:::benchmark_data_smithi116_28801_object1008:head, will try copies on 0,4 2024-09-16T15:02:42.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.322+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a418eab:::benchmark_data_smithi116_28801_object2314:head, will try copies on 0,4 2024-09-16T15:02:42.343 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.338+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5be6b545:::benchmark_data_smithi116_28801_object1506:head, will try copies on 3,4 2024-09-16T15:02:42.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.346+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:42.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864931f:::benchmark_data_smithi116_28801_object2615:head, will try copies on 0,4 2024-09-16T15:02:42.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.378+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:42.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 344 16 3757155 3757139 682.561 710.125 0.00128957 0.00145522 2024-09-16T15:02:42.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.378+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:42.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.382+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:02:42.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.414+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T15:02:42.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.450+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6656983b:::benchmark_data_smithi116_28801_object70:head, will try copies on 3,4 2024-09-16T15:02:42.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.462+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ef5b2c:::benchmark_data_smithi116_28801_object1242:head, will try copies on 2,3 2024-09-16T15:02:42.468 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.462+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:02:42.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0346bc:::benchmark_data_smithi116_28801_object350:head, will try copies on 2,3 2024-09-16T15:02:42.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.522+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba13f60b:::benchmark_data_smithi116_28801_object2526:head, will try copies on 2,3 2024-09-16T15:02:42.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.522+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:02:42.554 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.550+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:02:42.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.550+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:42.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.570+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:02:42.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.570+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:02:42.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.598+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6241162f:::benchmark_data_smithi116_28801_object1555:head, will try copies on 3,4 2024-09-16T15:02:42.612 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.606+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:02:42.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.630+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bfa858d:::benchmark_data_smithi116_28801_object2762:head, will try copies on 3,4 2024-09-16T15:02:42.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.630+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:02:42.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.650+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:02:42.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.654+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a4c71ad:::benchmark_data_smithi116_28801_object3814:head, will try copies on 3,4 2024-09-16T15:02:42.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.718+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631cd5ac:::benchmark_data_smithi116_28801_object1438:head, will try copies on 3,4 2024-09-16T15:02:42.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.734+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:02:42.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.734+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:259b7544:::benchmark_data_smithi116_28801_object657:head, will try copies on 0,4 2024-09-16T15:02:42.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.742+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5989810a:::benchmark_data_smithi116_28801_object2445:head, will try copies on 3,4 2024-09-16T15:02:42.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.742+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:02:42.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.770+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9595b7b:::benchmark_data_smithi116_28801_object502:head, will try copies on 2,3 2024-09-16T15:02:42.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.790+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29ea1dc4:::benchmark_data_smithi116_28801_object291:head, will try copies on 0,4 2024-09-16T15:02:42.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.794+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f052621:::benchmark_data_smithi116_28801_object3046:head, will try copies on 0,4 2024-09-16T15:02:42.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:42.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.834+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:02:42.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.850+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:42.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.874+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:02:42.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.874+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53766d82:::benchmark_data_smithi116_28801_object3155:head, will try copies on 3,4 2024-09-16T15:02:42.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.882+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:02:42.910 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.906+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1029e4:::benchmark_data_smithi116_28801_object974:head, will try copies on 0,4 2024-09-16T15:02:42.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.906+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:02:42.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.930+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:02:42.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.934+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:02:42.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.942+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:02:42.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.970+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54bd3ed5:::benchmark_data_smithi116_28801_object64:head, will try copies on 3,4 2024-09-16T15:02:42.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afa1ea8:::benchmark_data_smithi116_28801_object3373:head, will try copies on 0,4 2024-09-16T15:02:43.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:42.994+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669353b8:::benchmark_data_smithi116_28801_object409:head, will try copies on 3,4 2024-09-16T15:02:43.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.006+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2dd2fde:::benchmark_data_smithi116_28801_object1934:head, will try copies on 2,3 2024-09-16T15:02:43.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.010+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:02:43.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.034+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:02:43.058 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.054+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a83f5:::benchmark_data_smithi116_28801_object125:head, will try copies on 0,4 2024-09-16T15:02:43.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.070+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf8b5b6b:::benchmark_data_smithi116_28801_object3333:head, will try copies on 2,3 2024-09-16T15:02:43.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.086+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:02:43.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.102+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:02:43.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.114+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:02:43.133 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.130+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:02:43.138 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.134+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf55306d:::benchmark_data_smithi116_28801_object3856:head, will try copies on 2,3 2024-09-16T15:02:43.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.146+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ff1c374:::benchmark_data_smithi116_28801_object3574:head, will try copies on 0,4 2024-09-16T15:02:43.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.158+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:02:43.168 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.162+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:02:43.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.186+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:02:43.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.194+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672efc13:::benchmark_data_smithi116_28801_object1219:head, will try copies on 3,4 2024-09-16T15:02:43.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.194+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29c26a88:::benchmark_data_smithi116_28801_object3131:head, will try copies on 0,4 2024-09-16T15:02:43.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.214+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5817ef0a:::benchmark_data_smithi116_28801_object1655:head, will try copies on 3,4 2024-09-16T15:02:43.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.226+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:02:43.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.238+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:02:43.256 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.250+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:02:43.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:43.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.262+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:02:43.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.286+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f14f520:::benchmark_data_smithi116_28801_object937:head, will try copies on 0,4 2024-09-16T15:02:43.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.286+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:02:43.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.310+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:02:43.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.314+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60c90ba:::benchmark_data_smithi116_28801_object1178:head, will try copies on 2,3 2024-09-16T15:02:43.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.342+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:02:43.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.358+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21694faf:::benchmark_data_smithi116_28801_object2146:head, will try copies on 0,4 2024-09-16T15:02:43.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.370+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:02:43.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 345 16 3768209 3768193 682.585 690.875 0.000896547 0.00145518 2024-09-16T15:02:43.395 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.390+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a278214:::benchmark_data_smithi116_28801_object683:head, will try copies on 3,4 2024-09-16T15:02:43.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.394+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:02:43.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.398+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:02:43.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.410+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd41c2c:::benchmark_data_smithi116_28801_object2931:head, will try copies on 3,4 2024-09-16T15:02:43.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.410+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c5c8c5:::benchmark_data_smithi116_28801_object1135:head, will try copies on 2,3 2024-09-16T15:02:43.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a602e74:::benchmark_data_smithi116_28801_object4007:head, will try copies on 0,4 2024-09-16T15:02:43.444 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.438+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:43.470 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.466+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:02:43.474 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.470+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03b6875:::benchmark_data_smithi116_28801_object2449:head, will try copies on 2,3 2024-09-16T15:02:43.479 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.474+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfaae9:::benchmark_data_smithi116_28801_object3440:head, will try copies on 0,4 2024-09-16T15:02:43.483 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.478+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:541f24c5:::benchmark_data_smithi116_28801_object1906:head, will try copies on 3,4 2024-09-16T15:02:43.491 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.486+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:02:43.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.518+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:02:43.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.534+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b025bd77:::benchmark_data_smithi116_28801_object2742:head, will try copies on 2,3 2024-09-16T15:02:43.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.550+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfbb8d:::benchmark_data_smithi116_28801_object3701:head, will try copies on 0,4 2024-09-16T15:02:43.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.570+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:43.585 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.582+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:660908d9:::benchmark_data_smithi116_28801_object289:head, will try copies on 3,4 2024-09-16T15:02:43.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.602+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5efe4960:::benchmark_data_smithi116_28801_object2835:head, will try copies on 3,4 2024-09-16T15:02:43.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.630+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a457807:::benchmark_data_smithi116_28801_object2271:head, will try copies on 3,4 2024-09-16T15:02:43.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.630+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246cab54:::benchmark_data_smithi116_28801_object3175:head, will try copies on 0,4 2024-09-16T15:02:43.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.642+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:02:43.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.646+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:02:43.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.670+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657698a5:::benchmark_data_smithi116_28801_object1200:head, will try copies on 3,4 2024-09-16T15:02:43.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.686+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de8eadc:::benchmark_data_smithi116_28801_object1246:head, will try copies on 3,4 2024-09-16T15:02:43.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.706+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7e7be:::benchmark_data_smithi116_28801_object2485:head, will try copies on 3,4 2024-09-16T15:02:43.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.706+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcd60a5:::benchmark_data_smithi116_28801_object3981:head, will try copies on 0,4 2024-09-16T15:02:43.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.706+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2345db8d:::benchmark_data_smithi116_28801_object2436:head, will try copies on 0,4 2024-09-16T15:02:43.742 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.738+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:43.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.762+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad31c46:::benchmark_data_smithi116_28801_object3903:head, will try copies on 3,4 2024-09-16T15:02:43.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.794+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:02:43.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.802+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:43.829 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.826+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:02:43.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.842+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5457c483:::benchmark_data_smithi116_28801_object3641:head, will try copies on 3,4 2024-09-16T15:02:43.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.846+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:43.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.846+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9241d656:::benchmark_data_smithi116_28801_object3384:head, will try copies on 0,4 2024-09-16T15:02:43.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.886+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd540100:::benchmark_data_smithi116_28801_object4069:head, will try copies on 2,3 2024-09-16T15:02:43.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.894+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:43.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.902+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:02:43.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.914+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52a66fea:::benchmark_data_smithi116_28801_object2156:head, will try copies on 3,4 2024-09-16T15:02:43.921 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.918+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfba054:::benchmark_data_smithi116_28801_object1535:head, will try copies on 2,3 2024-09-16T15:02:43.964 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.958+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdcb2e0:::benchmark_data_smithi116_28801_object1066:head, will try copies on 3,4 2024-09-16T15:02:43.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.974+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5068636f:::benchmark_data_smithi116_28801_object728:head, will try copies on 3,4 2024-09-16T15:02:43.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:43.978+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:02:44.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.010+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9940fa46:::benchmark_data_smithi116_28801_object1532:head, will try copies on 0,4 2024-09-16T15:02:44.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.026+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:02:44.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.030+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:44.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.030+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9308df0c:::benchmark_data_smithi116_28801_object3254:head, will try copies on 0,4 2024-09-16T15:02:44.035 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.030+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b963e7fc:::benchmark_data_smithi116_28801_object293:head, will try copies on 2,3 2024-09-16T15:02:44.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.062+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98437995:::benchmark_data_smithi116_28801_object1806:head, will try copies on 0,4 2024-09-16T15:02:44.089 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.086+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:02:44.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.102+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2692ac83:::benchmark_data_smithi116_28801_object1478:head, will try copies on 0,4 2024-09-16T15:02:44.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.110+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:02:44.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.110+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:44.123 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.118+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbf0fc0:::benchmark_data_smithi116_28801_object12:head, will try copies on 0,4 2024-09-16T15:02:44.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.134+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:02:44.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.158+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:02:44.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.170+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a91ab2:::benchmark_data_smithi116_28801_object3556:head, will try copies on 0,4 2024-09-16T15:02:44.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.178+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66345843:::benchmark_data_smithi116_28801_object1364:head, will try copies on 3,4 2024-09-16T15:02:44.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.198+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e81aeaa:::benchmark_data_smithi116_28801_object3750:head, will try copies on 0,4 2024-09-16T15:02:44.206 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.202+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a86424:::benchmark_data_smithi116_28801_object1043:head, will try copies on 2,3 2024-09-16T15:02:44.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.202+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:02:44.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.202+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56640fae:::benchmark_data_smithi116_28801_object664:head, will try copies on 3,4 2024-09-16T15:02:44.210 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.206+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6234d169:::benchmark_data_smithi116_28801_object3752:head, will try copies on 3,4 2024-09-16T15:02:44.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.226+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:02:44.247 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.242+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:44.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:02:44.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.274+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:02:44.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.278+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:02:44.324 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.318+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:02:44.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.326+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:02:44.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.346+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:02:44.356 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.350+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622ef613:::benchmark_data_smithi116_28801_object963:head, will try copies on 3,4 2024-09-16T15:02:44.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.354+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579bcff0:::benchmark_data_smithi116_28801_object3828:head, will try copies on 3,4 2024-09-16T15:02:44.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8a2f83:::benchmark_data_smithi116_28801_object418:head, will try copies on 0,4 2024-09-16T15:02:44.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 346 16 3779133 3779117 682.586 682.75 0.00069417 0.00145517 2024-09-16T15:02:44.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.382+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:02:44.399 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.394+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T15:02:44.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.442+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:02:44.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.462+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d25a0b:::benchmark_data_smithi116_28801_object2092:head, will try copies on 0,4 2024-09-16T15:02:44.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.490+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e17d0:::benchmark_data_smithi116_28801_object1641:head, will try copies on 3,4 2024-09-16T15:02:44.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.494+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c4e955:::benchmark_data_smithi116_28801_object4052:head, will try copies on 2,3 2024-09-16T15:02:44.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.558+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d44d3e:::benchmark_data_smithi116_28801_object3539:head, will try copies on 0,4 2024-09-16T15:02:44.579 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.574+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b897054:::benchmark_data_smithi116_28801_object2439:head, will try copies on 3,4 2024-09-16T15:02:44.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.578+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:02:44.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.578+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53972d01:::benchmark_data_smithi116_28801_object2286:head, will try copies on 3,4 2024-09-16T15:02:44.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.598+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6701ee2d:::benchmark_data_smithi116_28801_object3753:head, will try copies on 3,4 2024-09-16T15:02:44.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.602+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9303b64a:::benchmark_data_smithi116_28801_object3824:head, will try copies on 0,4 2024-09-16T15:02:44.617 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.614+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27063347:::benchmark_data_smithi116_28801_object3586:head, will try copies on 0,4 2024-09-16T15:02:44.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.638+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c913dd:::benchmark_data_smithi116_28801_object604:head, will try copies on 2,3 2024-09-16T15:02:44.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.642+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f50442d:::benchmark_data_smithi116_28801_object3345:head, will try copies on 3,4 2024-09-16T15:02:44.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.646+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92ceebee:::benchmark_data_smithi116_28801_object1725:head, will try copies on 0,4 2024-09-16T15:02:44.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.666+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:02:44.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.674+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b05af680:::benchmark_data_smithi116_28801_object881:head, will try copies on 2,3 2024-09-16T15:02:44.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.710+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d379f33:::benchmark_data_smithi116_28801_object3870:head, will try copies on 3,4 2024-09-16T15:02:44.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.742+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b59f7d83:::benchmark_data_smithi116_28801_object3401:head, will try copies on 2,3 2024-09-16T15:02:44.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.746+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22913897:::benchmark_data_smithi116_28801_object1223:head, will try copies on 0,4 2024-09-16T15:02:44.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.754+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:02:44.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.778+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e39d67:::benchmark_data_smithi116_28801_object789:head, will try copies on 2,3 2024-09-16T15:02:44.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.802+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:44.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.806+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:02:44.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.822+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:631a89c8:::benchmark_data_smithi116_28801_object2796:head, will try copies on 3,4 2024-09-16T15:02:44.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.834+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244a49a3:::benchmark_data_smithi116_28801_object727:head, will try copies on 0,4 2024-09-16T15:02:44.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.838+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:02:44.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.850+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:02:44.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.882+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab7c8a8:::benchmark_data_smithi116_28801_object4121:head, will try copies on 2,3 2024-09-16T15:02:44.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.882+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:02:44.893 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2291aed9:::benchmark_data_smithi116_28801_object2474:head, will try copies on 0,4 2024-09-16T15:02:44.900 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.894+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc79527:::benchmark_data_smithi116_28801_object2755:head, will try copies on 3,4 2024-09-16T15:02:44.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.926+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T15:02:44.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.934+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T15:02:44.957 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.954+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b182377:::benchmark_data_smithi116_28801_object1518:head, will try copies on 3,4 2024-09-16T15:02:44.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.974+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:02:44.980 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.974+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23df2a2c:::benchmark_data_smithi116_28801_object1640:head, will try copies on 0,4 2024-09-16T15:02:44.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.990+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:02:44.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:44.994+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:02:45.008 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.002+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:02:45.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.014+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:02:45.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.038+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f2d8e3:::benchmark_data_smithi116_28801_object1859:head, will try copies on 3,4 2024-09-16T15:02:45.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.050+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cff945a:::benchmark_data_smithi116_28801_object1157:head, will try copies on 0,4 2024-09-16T15:02:45.081 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.078+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52584534:::benchmark_data_smithi116_28801_object123:head, will try copies on 3,4 2024-09-16T15:02:45.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.102+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:02:45.109 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.106+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:45.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.122+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2044fd9d:::benchmark_data_smithi116_28801_object2686:head, will try copies on 0,4 2024-09-16T15:02:45.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.142+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987a2733:::benchmark_data_smithi116_28801_object3621:head, will try copies on 0,4 2024-09-16T15:02:45.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.150+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:02:45.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.154+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2afb4c3b:::benchmark_data_smithi116_28801_object824:head, will try copies on 0,4 2024-09-16T15:02:45.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.158+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bc5a4dd:::benchmark_data_smithi116_28801_object1763:head, will try copies on 3,4 2024-09-16T15:02:45.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.170+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:02:45.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.198+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:02:45.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.226+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528d5565:::benchmark_data_smithi116_28801_object2576:head, will try copies on 3,4 2024-09-16T15:02:45.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.234+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:02:45.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.246+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:02:45.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.250+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cab7:::benchmark_data_smithi116_28801_object4102:head, will try copies on 0,4 2024-09-16T15:02:45.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.262+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc68b2:::benchmark_data_smithi116_28801_object194:head, will try copies on 3,4 2024-09-16T15:02:45.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.282+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb239f0d:::benchmark_data_smithi116_28801_object2187:head, will try copies on 2,3 2024-09-16T15:02:45.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.290+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:02:45.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.334+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:02:45.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.338+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0fe672:::benchmark_data_smithi116_28801_object2262:head, will try copies on 2,3 2024-09-16T15:02:45.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.362+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:671e70d0:::benchmark_data_smithi116_28801_object638:head, will try copies on 3,4 2024-09-16T15:02:45.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.374+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254b0c05:::benchmark_data_smithi116_28801_object3308:head, will try copies on 0,4 2024-09-16T15:02:45.379 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.374+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:02:45.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 347 16 3790395 3790379 682.647 703.875 0.00353791 0.00145504 2024-09-16T15:02:45.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.394+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:02:45.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.422+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:02:45.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.422+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ead965:::benchmark_data_smithi116_28801_object4105:head, will try copies on 2,3 2024-09-16T15:02:45.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.422+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a902d99:::benchmark_data_smithi116_28801_object1037:head, will try copies on 3,4 2024-09-16T15:02:45.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.434+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3644cf:::benchmark_data_smithi116_28801_object580:head, will try copies on 0,4 2024-09-16T15:02:45.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.454+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:02:45.467 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.462+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:02:45.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.498+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bc07e8:::benchmark_data_smithi116_28801_object2403:head, will try copies on 0,4 2024-09-16T15:02:45.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.510+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9d9f88:::benchmark_data_smithi116_28801_object1747:head, will try copies on 0,4 2024-09-16T15:02:45.526 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.522+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c27b799:::benchmark_data_smithi116_28801_object3844:head, will try copies on 3,4 2024-09-16T15:02:45.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99453f0f:::benchmark_data_smithi116_28801_object2423:head, will try copies on 0,4 2024-09-16T15:02:45.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.538+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:02:45.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.566+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275dbcb7:::benchmark_data_smithi116_28801_object2653:head, will try copies on 0,4 2024-09-16T15:02:45.586 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.582+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966c471a:::benchmark_data_smithi116_28801_object2858:head, will try copies on 0,4 2024-09-16T15:02:45.587 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.582+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:02:45.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.598+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7af257:::benchmark_data_smithi116_28801_object2644:head, will try copies on 3,4 2024-09-16T15:02:45.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.602+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f18cf10:::benchmark_data_smithi116_28801_object1367:head, will try copies on 0,4 2024-09-16T15:02:45.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.602+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23cfd486:::benchmark_data_smithi116_28801_object3195:head, will try copies on 0,4 2024-09-16T15:02:45.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.638+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:02:45.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.654+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2574c413:::benchmark_data_smithi116_28801_object762:head, will try copies on 0,4 2024-09-16T15:02:45.673 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.670+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:02:45.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.670+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:45.678 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.674+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:45.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.706+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:02:45.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.742+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:02:45.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.746+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:02:45.754 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.750+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c637be1:::benchmark_data_smithi116_28801_object3066:head, will try copies on 0,4 2024-09-16T15:02:45.785 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.782+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:02:45.787 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.782+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d2a5f2:::benchmark_data_smithi116_28801_object3540:head, will try copies on 3,4 2024-09-16T15:02:45.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.814+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75b45c5:::benchmark_data_smithi116_28801_object986:head, will try copies on 2,3 2024-09-16T15:02:45.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.830+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538b7bb7:::benchmark_data_smithi116_28801_object2920:head, will try copies on 3,4 2024-09-16T15:02:45.843 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.838+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895c6da:::benchmark_data_smithi116_28801_object3511:head, will try copies on 3,4 2024-09-16T15:02:45.846 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.842+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:02:45.853 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.850+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cd041c4:::benchmark_data_smithi116_28801_object2932:head, will try copies on 0,4 2024-09-16T15:02:45.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.890+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:02:45.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.894+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:02:45.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.898+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:02:45.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.902+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a8497f:::benchmark_data_smithi116_28801_object79:head, will try copies on 0,4 2024-09-16T15:02:45.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.942+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:02:45.947 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.942+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b255b142:::benchmark_data_smithi116_28801_object2256:head, will try copies on 2,3 2024-09-16T15:02:45.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.958+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a6e765c:::benchmark_data_smithi116_28801_object863:head, will try copies on 0,4 2024-09-16T15:02:45.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.962+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ea063c:::benchmark_data_smithi116_28801_object3080:head, will try copies on 3,4 2024-09-16T15:02:45.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.982+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b116deef:::benchmark_data_smithi116_28801_object3691:head, will try copies on 2,3 2024-09-16T15:02:45.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:45.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd302b4:::benchmark_data_smithi116_28801_object1458:head, will try copies on 0,4 2024-09-16T15:02:46.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.030+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:02:46.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.042+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627eb40d:::benchmark_data_smithi116_28801_object3987:head, will try copies on 3,4 2024-09-16T15:02:46.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.058+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2207b014:::benchmark_data_smithi116_28801_object704:head, will try copies on 0,4 2024-09-16T15:02:46.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.062+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c327fa5:::benchmark_data_smithi116_28801_object524:head, will try copies on 3,4 2024-09-16T15:02:46.080 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.074+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9df1cf4f:::benchmark_data_smithi116_28801_object392:head, will try copies on 0,4 2024-09-16T15:02:46.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.086+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b502328:::benchmark_data_smithi116_28801_object274:head, will try copies on 3,4 2024-09-16T15:02:46.093 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.090+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:02:46.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.138+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bebb901:::benchmark_data_smithi116_28801_object3167:head, will try copies on 0,4 2024-09-16T15:02:46.150 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.146+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5862bfdd:::benchmark_data_smithi116_28801_object1333:head, will try copies on 3,4 2024-09-16T15:02:46.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.154+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3ee6e26:::benchmark_data_smithi116_28801_object205:head, will try copies on 2,3 2024-09-16T15:02:46.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.154+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:02:46.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.158+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:02:46.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.190+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8b62124:::benchmark_data_smithi116_28801_object3480:head, will try copies on 2,3 2024-09-16T15:02:46.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.194+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:02:46.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.194+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cb0ef90:::benchmark_data_smithi116_28801_object3125:head, will try copies on 3,4 2024-09-16T15:02:46.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.206+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92753d0b:::benchmark_data_smithi116_28801_object1523:head, will try copies on 0,4 2024-09-16T15:02:46.244 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.238+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:02:46.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.266+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f0ac93d:::benchmark_data_smithi116_28801_object1839:head, will try copies on 3,4 2024-09-16T15:02:46.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.270+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:02:46.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.270+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:02:46.289 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.286+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aa8971d:::benchmark_data_smithi116_28801_object3555:head, will try copies on 3,4 2024-09-16T15:02:46.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.326+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21048c3e:::benchmark_data_smithi116_28801_object3086:head, will try copies on 0,4 2024-09-16T15:02:46.351 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.346+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:46.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.370+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8672d4:::benchmark_data_smithi116_28801_object3971:head, will try copies on 0,4 2024-09-16T15:02:46.376 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.370+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:02:46.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.374+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:02:46.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 348 16 3801702 3801686 682.716 706.688 0.0012571 0.0014549 2024-09-16T15:02:46.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.386+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27a84f87:::benchmark_data_smithi116_28801_object288:head, will try copies on 0,4 2024-09-16T15:02:46.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.386+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138f7f7:::benchmark_data_smithi116_28801_object4101:head, will try copies on 3,4 2024-09-16T15:02:46.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.410+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:02:46.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.438+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:02:46.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.442+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:615ec258:::benchmark_data_smithi116_28801_object776:head, will try copies on 3,4 2024-09-16T15:02:46.456 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.450+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:02:46.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.454+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:02:46.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.486+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:02:46.503 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.498+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:02:46.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.542+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c9b0a00:::benchmark_data_smithi116_28801_object2109:head, will try copies on 0,4 2024-09-16T15:02:46.547 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.542+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0c5d78:::benchmark_data_smithi116_28801_object3498:head, will try copies on 0,4 2024-09-16T15:02:46.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.546+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:606cb22f:::benchmark_data_smithi116_28801_object2477:head, will try copies on 3,4 2024-09-16T15:02:46.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.574+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c52051:::benchmark_data_smithi116_28801_object534:head, will try copies on 0,4 2024-09-16T15:02:46.590 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.586+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d262cb:::benchmark_data_smithi116_28801_object626:head, will try copies on 2,3 2024-09-16T15:02:46.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.594+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:02:46.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.602+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:02:46.611 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.606+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52d16cc4:::benchmark_data_smithi116_28801_object808:head, will try copies on 3,4 2024-09-16T15:02:46.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.610+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1718b7c:::benchmark_data_smithi116_28801_object3286:head, will try copies on 2,3 2024-09-16T15:02:46.624 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.618+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f263e4:::benchmark_data_smithi116_28801_object1801:head, will try copies on 0,4 2024-09-16T15:02:46.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.654+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:02:46.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.658+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f0e70b:::benchmark_data_smithi116_28801_object3643:head, will try copies on 3,4 2024-09-16T15:02:46.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.662+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:02:46.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.694+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b5e2ae:::benchmark_data_smithi116_28801_object722:head, will try copies on 3,4 2024-09-16T15:02:46.702 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.698+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f6fae4:::benchmark_data_smithi116_28801_object2239:head, will try copies on 2,3 2024-09-16T15:02:46.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.706+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:02:46.717 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.714+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:02:46.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.722+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e1d9326:::benchmark_data_smithi116_28801_object1877:head, will try copies on 0,4 2024-09-16T15:02:46.755 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.750+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:02:46.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.750+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:02:46.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba5bc506:::benchmark_data_smithi116_28801_object3078:head, will try copies on 2,3 2024-09-16T15:02:46.804 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.798+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:02:46.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c1e3b92:::benchmark_data_smithi116_28801_object2111:head, will try copies on 3,4 2024-09-16T15:02:46.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.826+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc2fd0f5:::benchmark_data_smithi116_28801_object245:head, will try copies on 2,3 2024-09-16T15:02:46.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.838+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:02:46.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.854+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549b1cbb:::benchmark_data_smithi116_28801_object2387:head, will try copies on 3,4 2024-09-16T15:02:46.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.862+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c0c136:::benchmark_data_smithi116_28801_object1108:head, will try copies on 2,3 2024-09-16T15:02:46.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.866+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a41be7:::benchmark_data_smithi116_28801_object3153:head, will try copies on 0,4 2024-09-16T15:02:46.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.874+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:02:46.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.910+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5933bb7d:::benchmark_data_smithi116_28801_object777:head, will try copies on 3,4 2024-09-16T15:02:46.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.926+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a606adb:::benchmark_data_smithi116_28801_object1712:head, will try copies on 0,4 2024-09-16T15:02:46.934 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.930+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:02:46.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.934+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b84d5d4:::benchmark_data_smithi116_28801_object2833:head, will try copies on 3,4 2024-09-16T15:02:46.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.934+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:02:46.939 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.934+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f825924:::benchmark_data_smithi116_28801_object4029:head, will try copies on 0,4 2024-09-16T15:02:46.962 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:46.958+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8fd5fb:::benchmark_data_smithi116_28801_object2128:head, will try copies on 0,4 2024-09-16T15:02:47.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.002+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2ccecc8:::benchmark_data_smithi116_28801_object1243:head, will try copies on 2,3 2024-09-16T15:02:47.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.026+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e4b54c:::benchmark_data_smithi116_28801_object1660:head, will try copies on 2,3 2024-09-16T15:02:47.039 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.034+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5531c135:::benchmark_data_smithi116_28801_object3040:head, will try copies on 3,4 2024-09-16T15:02:47.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.042+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3b9605:::benchmark_data_smithi116_28801_object2841:head, will try copies on 0,4 2024-09-16T15:02:47.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.042+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a1188a:::benchmark_data_smithi116_28801_object800:head, will try copies on 0,4 2024-09-16T15:02:47.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.058+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:02:47.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.062+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b8dfa6:::benchmark_data_smithi116_28801_object482:head, will try copies on 3,4 2024-09-16T15:02:47.076 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.070+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20dc9204:::benchmark_data_smithi116_28801_object2354:head, will try copies on 0,4 2024-09-16T15:02:47.092 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.086+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed103fc:::benchmark_data_smithi116_28801_object3149:head, will try copies on 3,4 2024-09-16T15:02:47.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.142+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:02:47.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.150+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5a4b7f:::benchmark_data_smithi116_28801_object1191:head, will try copies on 2,3 2024-09-16T15:02:47.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.170+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:47.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.186+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d097f3e:::benchmark_data_smithi116_28801_object3399:head, will try copies on 3,4 2024-09-16T15:02:47.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.186+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:47.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.210+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:02:47.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.214+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:02:47.228 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.222+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e64037:::benchmark_data_smithi116_28801_object2117:head, will try copies on 0,4 2024-09-16T15:02:47.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.234+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:02:47.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.242+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:02:47.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.250+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53324b5e:::benchmark_data_smithi116_28801_object1694:head, will try copies on 3,4 2024-09-16T15:02:47.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.290+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94a37312:::benchmark_data_smithi116_28801_object1335:head, will try copies on 0,4 2024-09-16T15:02:47.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.290+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a5fb0ef:::benchmark_data_smithi116_28801_object208:head, will try copies on 3,4 2024-09-16T15:02:47.317 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.310+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:02:47.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.314+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:02:47.341 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.338+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:232ed73a:::benchmark_data_smithi116_28801_object1213:head, will try copies on 0,4 2024-09-16T15:02:47.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.350+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9817585e:::benchmark_data_smithi116_28801_object1618:head, will try copies on 0,4 2024-09-16T15:02:47.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.350+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516591f7:::benchmark_data_smithi116_28801_object2805:head, will try copies on 3,4 2024-09-16T15:02:47.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.354+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a404873:::benchmark_data_smithi116_28801_object1179:head, will try copies on 3,4 2024-09-16T15:02:47.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.354+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:47.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.362+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f7016e:::benchmark_data_smithi116_28801_object1689:head, will try copies on 2,3 2024-09-16T15:02:47.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 349 15 3812665 3812650 682.723 685.25 0.00117647 0.00145487 2024-09-16T15:02:47.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.406+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T15:02:47.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.422+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f75f:::benchmark_data_smithi116_28801_object1034:head, will try copies on 2,3 2024-09-16T15:02:47.434 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.430+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:02:47.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.486+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:02:47.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.486+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be51790a:::benchmark_data_smithi116_28801_object3857:head, will try copies on 2,3 2024-09-16T15:02:47.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.506+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T15:02:47.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.518+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62c3c5b3:::benchmark_data_smithi116_28801_object3550:head, will try copies on 3,4 2024-09-16T15:02:47.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.518+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:02:47.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.550+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52efabab:::benchmark_data_smithi116_28801_object680:head, will try copies on 3,4 2024-09-16T15:02:47.562 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.558+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf4135f1:::benchmark_data_smithi116_28801_object2344:head, will try copies on 2,3 2024-09-16T15:02:47.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.590+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:02:47.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.606+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a44ed5:::benchmark_data_smithi116_28801_object3840:head, will try copies on 2,3 2024-09-16T15:02:47.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.610+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:02:47.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.634+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a16fab:::benchmark_data_smithi116_28801_object973:head, will try copies on 0,4 2024-09-16T15:02:47.663 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.658+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223287dc:::benchmark_data_smithi116_28801_object844:head, will try copies on 0,4 2024-09-16T15:02:47.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.662+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:965199bb:::benchmark_data_smithi116_28801_object2541:head, will try copies on 0,4 2024-09-16T15:02:47.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.682+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:02:47.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.686+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:02:47.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.734+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f2d2eac:::benchmark_data_smithi116_28801_object313:head, will try copies on 3,4 2024-09-16T15:02:47.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.742+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216b8cce:::benchmark_data_smithi116_28801_object2153:head, will try copies on 0,4 2024-09-16T15:02:47.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.750+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:02:47.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.762+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f04450b:::benchmark_data_smithi116_28801_object2557:head, will try copies on 3,4 2024-09-16T15:02:47.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.774+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54e92b9e:::benchmark_data_smithi116_28801_object1794:head, will try copies on 3,4 2024-09-16T15:02:47.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:02:47.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.830+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d6d0b0:::benchmark_data_smithi116_28801_object1095:head, will try copies on 0,4 2024-09-16T15:02:47.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.834+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:02:47.840 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.834+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:02:47.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.842+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:02:47.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.882+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97668b31:::benchmark_data_smithi116_28801_object334:head, will try copies on 0,4 2024-09-16T15:02:47.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.890+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:02:47.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.910+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:02:47.916 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.910+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:02:47.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.926+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92bbeaac:::benchmark_data_smithi116_28801_object1753:head, will try copies on 0,4 2024-09-16T15:02:47.933 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.930+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64943e12:::benchmark_data_smithi116_28801_object3780:head, will try copies on 3,4 2024-09-16T15:02:47.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.930+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0426100:::benchmark_data_smithi116_28801_object2937:head, will try copies on 2,3 2024-09-16T15:02:47.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.938+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f3859d9:::benchmark_data_smithi116_28801_object1332:head, will try copies on 3,4 2024-09-16T15:02:47.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.950+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:241edf98:::benchmark_data_smithi116_28801_object3136:head, will try copies on 0,4 2024-09-16T15:02:47.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.990+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:48.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:47.994+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:02:48.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.022+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:02:48.027 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.022+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab1a33c:::benchmark_data_smithi116_28801_object96:head, will try copies on 3,4 2024-09-16T15:02:48.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.062+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:02:48.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.062+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:02:48.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.066+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61019e5f:::benchmark_data_smithi116_28801_object3365:head, will try copies on 3,4 2024-09-16T15:02:48.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.066+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:02:48.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.106+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:02:48.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.110+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68a3f98a:::benchmark_data_smithi116_28801_object2289:head, will try copies on 3,4 2024-09-16T15:02:48.127 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.122+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:02:48.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.130+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b34935fb:::benchmark_data_smithi116_28801_object3129:head, will try copies on 2,3 2024-09-16T15:02:48.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.142+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2241f571:::benchmark_data_smithi116_28801_object848:head, will try copies on 0,4 2024-09-16T15:02:48.154 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.150+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:02:48.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.174+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:02:48.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.194+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a2f5d6f:::benchmark_data_smithi116_28801_object3026:head, will try copies on 0,4 2024-09-16T15:02:48.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.202+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:02:48.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.210+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8f8156:::benchmark_data_smithi116_28801_object348:head, will try copies on 3,4 2024-09-16T15:02:48.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.218+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52704bf:::benchmark_data_smithi116_28801_object1580:head, will try copies on 2,3 2024-09-16T15:02:48.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.238+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:48.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ee0b2e:::benchmark_data_smithi116_28801_object2233:head, will try copies on 3,4 2024-09-16T15:02:48.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.262+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:02:48.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.274+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:48.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.274+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:48.301 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.298+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ed8af19:::benchmark_data_smithi116_28801_object2586:head, will try copies on 3,4 2024-09-16T15:02:48.308 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.302+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:02:48.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.322+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2344754f:::benchmark_data_smithi116_28801_object2905:head, will try copies on 0,4 2024-09-16T15:02:48.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.326+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b26de6:::benchmark_data_smithi116_28801_object3162:head, will try copies on 3,4 2024-09-16T15:02:48.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.334+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:02:48.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.354+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2102b7:::benchmark_data_smithi116_28801_object285:head, will try copies on 0,4 2024-09-16T15:02:48.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.358+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fa7a502:::benchmark_data_smithi116_28801_object337:head, will try copies on 3,4 2024-09-16T15:02:48.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.366+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2930f204:::benchmark_data_smithi116_28801_object1985:head, will try copies on 0,4 2024-09-16T15:02:48.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.370+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bccccf5d:::benchmark_data_smithi116_28801_object2746:head, will try copies on 2,3 2024-09-16T15:02:48.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 350 16 3823091 3823075 682.634 651.562 0.00310496 0.00145506 2024-09-16T15:02:48.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.386+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:02:48.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.414+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8ce0fa:::benchmark_data_smithi116_28801_object3290:head, will try copies on 0,4 2024-09-16T15:02:48.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.446+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d914cde:::benchmark_data_smithi116_28801_object2048:head, will try copies on 0,4 2024-09-16T15:02:48.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.474+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1b93a91:::benchmark_data_smithi116_28801_object2460:head, will try copies on 2,3 2024-09-16T15:02:48.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.482+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c1795e4:::benchmark_data_smithi116_28801_object252:head, will try copies on 0,4 2024-09-16T15:02:48.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.482+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:02:48.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:02:48.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.510+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f68c25f:::benchmark_data_smithi116_28801_object2272:head, will try copies on 0,4 2024-09-16T15:02:48.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.526+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0223043:::benchmark_data_smithi116_28801_object2222:head, will try copies on 2,3 2024-09-16T15:02:48.566 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.562+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:02:48.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.566+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27911f7c:::benchmark_data_smithi116_28801_object3361:head, will try copies on 0,4 2024-09-16T15:02:48.591 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.586+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T15:02:48.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.606+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:02:48.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.606+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cbd913e:::benchmark_data_smithi116_28801_object784:head, will try copies on 0,4 2024-09-16T15:02:48.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.634+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:02:48.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.638+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:02:48.642 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.638+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c24b2b9:::benchmark_data_smithi116_28801_object740:head, will try copies on 0,4 2024-09-16T15:02:48.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.662+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68667869:::benchmark_data_smithi116_28801_object3972:head, will try copies on 3,4 2024-09-16T15:02:48.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.662+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:991c3b58:::benchmark_data_smithi116_28801_object536:head, will try copies on 0,4 2024-09-16T15:02:48.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.666+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T15:02:48.701 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.698+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6693a347:::benchmark_data_smithi116_28801_object2655:head, will try copies on 3,4 2024-09-16T15:02:48.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.710+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55bf7989:::benchmark_data_smithi116_28801_object2758:head, will try copies on 3,4 2024-09-16T15:02:48.713 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.710+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:02:48.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.734+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:becda749:::benchmark_data_smithi116_28801_object717:head, will try copies on 2,3 2024-09-16T15:02:48.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.758+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:02:48.777 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.774+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:02:48.800 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.794+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:621e8a86:::benchmark_data_smithi116_28801_object2629:head, will try copies on 3,4 2024-09-16T15:02:48.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.802+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576ffc73:::benchmark_data_smithi116_28801_object3108:head, will try copies on 3,4 2024-09-16T15:02:48.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.814+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21909b10:::benchmark_data_smithi116_28801_object4091:head, will try copies on 0,4 2024-09-16T15:02:48.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.818+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:02:48.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.842+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d77d613:::benchmark_data_smithi116_28801_object1173:head, will try copies on 3,4 2024-09-16T15:02:48.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.854+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21fd9218:::benchmark_data_smithi116_28801_object283:head, will try copies on 0,4 2024-09-16T15:02:48.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.878+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914818cb:::benchmark_data_smithi116_28801_object579:head, will try copies on 0,4 2024-09-16T15:02:48.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.894+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:02:48.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.898+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:02:48.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.902+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:998ee496:::benchmark_data_smithi116_28801_object742:head, will try copies on 0,4 2024-09-16T15:02:48.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.914+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:02:48.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.934+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfe783ac:::benchmark_data_smithi116_28801_object1804:head, will try copies on 2,3 2024-09-16T15:02:48.956 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.950+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b918794:::benchmark_data_smithi116_28801_object2717:head, will try copies on 0,4 2024-09-16T15:02:48.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.974+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2192dec9:::benchmark_data_smithi116_28801_object3991:head, will try copies on 0,4 2024-09-16T15:02:48.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:48.982+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f664df:::benchmark_data_smithi116_28801_object778:head, will try copies on 2,3 2024-09-16T15:02:49.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.022+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:207e0abc:::benchmark_data_smithi116_28801_object1002:head, will try copies on 0,4 2024-09-16T15:02:49.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.026+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bd905f:::benchmark_data_smithi116_28801_object3325:head, will try copies on 3,4 2024-09-16T15:02:49.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.026+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0998a44:::benchmark_data_smithi116_28801_object3942:head, will try copies on 2,3 2024-09-16T15:02:49.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.030+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c08321f:::benchmark_data_smithi116_28801_object1880:head, will try copies on 0,4 2024-09-16T15:02:49.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.050+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:02:49.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.082+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67db5d21:::benchmark_data_smithi116_28801_object3012:head, will try copies on 3,4 2024-09-16T15:02:49.099 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.094+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd25a819:::benchmark_data_smithi116_28801_object2896:head, will try copies on 2,3 2024-09-16T15:02:49.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.102+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6c46d4:::benchmark_data_smithi116_28801_object1430:head, will try copies on 3,4 2024-09-16T15:02:49.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.130+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657a039:::benchmark_data_smithi116_28801_object1297:head, will try copies on 3,4 2024-09-16T15:02:49.157 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.154+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26829821:::benchmark_data_smithi116_28801_object3714:head, will try copies on 0,4 2024-09-16T15:02:49.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.162+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:02:49.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.162+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695b063a:::benchmark_data_smithi116_28801_object1146:head, will try copies on 3,4 2024-09-16T15:02:49.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.190+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2388ab83:::benchmark_data_smithi116_28801_object2292:head, will try copies on 0,4 2024-09-16T15:02:49.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.214+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b45b0860:::benchmark_data_smithi116_28801_object876:head, will try copies on 2,3 2024-09-16T15:02:49.225 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.222+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a3096f5:::benchmark_data_smithi116_28801_object1402:head, will try copies on 0,4 2024-09-16T15:02:49.250 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.246+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:02:49.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.250+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b7f139:::benchmark_data_smithi116_28801_object3496:head, will try copies on 3,4 2024-09-16T15:02:49.255 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.250+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2589f7ec:::benchmark_data_smithi116_28801_object318:head, will try copies on 0,4 2024-09-16T15:02:49.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.266+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:02:49.293 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.290+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d7cee5:::benchmark_data_smithi116_28801_object2533:head, will try copies on 3,4 2024-09-16T15:02:49.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.294+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21479f9:::benchmark_data_smithi116_28801_object332:head, will try copies on 2,3 2024-09-16T15:02:49.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.302+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:02:49.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.334+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff36f53:::benchmark_data_smithi116_28801_object4127:head, will try copies on 0,4 2024-09-16T15:02:49.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.362+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:02:49.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.370+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:02:49.384 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.378+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:02:49.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 351 15 3834329 3834314 682.69 702.438 0.000720025 0.00145495 2024-09-16T15:02:49.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.426+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:02:49.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.434+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047f9ac:::benchmark_data_smithi116_28801_object3478:head, will try copies on 3,4 2024-09-16T15:02:49.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.438+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f88b5e6:::benchmark_data_smithi116_28801_object355:head, will try copies on 3,4 2024-09-16T15:02:49.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.450+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a4b6fc:::benchmark_data_smithi116_28801_object3419:head, will try copies on 0,4 2024-09-16T15:02:49.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.450+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:02:49.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.450+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:02:49.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.490+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7aa2791:::benchmark_data_smithi116_28801_object1258:head, will try copies on 2,3 2024-09-16T15:02:49.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.498+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:02:49.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.502+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:02:49.508 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.502+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60bbe81d:::benchmark_data_smithi116_28801_object783:head, will try copies on 3,4 2024-09-16T15:02:49.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.506+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:02:49.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.542+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97880775:::benchmark_data_smithi116_28801_object1022:head, will try copies on 0,4 2024-09-16T15:02:49.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.562+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:533b3f0e:::benchmark_data_smithi116_28801_object262:head, will try copies on 3,4 2024-09-16T15:02:49.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.606+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:02:49.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.622+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22f31eae:::benchmark_data_smithi116_28801_object834:head, will try copies on 0,4 2024-09-16T15:02:49.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.630+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:02:49.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.638+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T15:02:49.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.670+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b945f684:::benchmark_data_smithi116_28801_object3017:head, will try copies on 2,3 2024-09-16T15:02:49.700 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.694+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:02:49.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.710+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:02:49.716 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.710+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc168d:::benchmark_data_smithi116_28801_object1216:head, will try copies on 3,4 2024-09-16T15:02:49.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.714+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98be97c9:::benchmark_data_smithi116_28801_object3689:head, will try copies on 0,4 2024-09-16T15:02:49.723 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.718+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25d9df5e:::benchmark_data_smithi116_28801_object2277:head, will try copies on 0,4 2024-09-16T15:02:49.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.734+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6d8aedb:::benchmark_data_smithi116_28801_object3396:head, will try copies on 2,3 2024-09-16T15:02:49.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.734+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56f7e8bb:::benchmark_data_smithi116_28801_object854:head, will try copies on 3,4 2024-09-16T15:02:49.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.754+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98052b01:::benchmark_data_smithi116_28801_object1005:head, will try copies on 0,4 2024-09-16T15:02:49.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.778+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fec93:::benchmark_data_smithi116_28801_object923:head, will try copies on 2,3 2024-09-16T15:02:49.803 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.798+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:02:49.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.802+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:02:49.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.810+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2597f83e:::benchmark_data_smithi116_28801_object1141:head, will try copies on 0,4 2024-09-16T15:02:49.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.826+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1edc7e3:::benchmark_data_smithi116_28801_object3472:head, will try copies on 2,3 2024-09-16T15:02:49.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.838+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:666f0ceb:::benchmark_data_smithi116_28801_object2301:head, will try copies on 3,4 2024-09-16T15:02:49.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.842+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:02:49.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.878+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d9e3c87:::benchmark_data_smithi116_28801_object1755:head, will try copies on 3,4 2024-09-16T15:02:49.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.882+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9eb3d:::benchmark_data_smithi116_28801_object1557:head, will try copies on 3,4 2024-09-16T15:02:49.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.886+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f07281d:::benchmark_data_smithi116_28801_object1873:head, will try copies on 0,4 2024-09-16T15:02:49.907 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.902+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc5fc7f6:::benchmark_data_smithi116_28801_object3056:head, will try copies on 2,3 2024-09-16T15:02:49.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.914+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ca86c:::benchmark_data_smithi116_28801_object3177:head, will try copies on 0,4 2024-09-16T15:02:49.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.934+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:958de0e6:::benchmark_data_smithi116_28801_object1765:head, will try copies on 0,4 2024-09-16T15:02:49.949 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.946+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3e8172:::benchmark_data_smithi116_28801_object813:head, will try copies on 2,3 2024-09-16T15:02:49.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.950+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ca44cd:::benchmark_data_smithi116_28801_object1030:head, will try copies on 3,4 2024-09-16T15:02:49.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:49.974+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:02:50.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.030+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c8c258:::benchmark_data_smithi116_28801_object2248:head, will try copies on 3,4 2024-09-16T15:02:50.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bee228:::benchmark_data_smithi116_28801_object256:head, will try copies on 3,4 2024-09-16T15:02:50.045 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.042+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc468375:::benchmark_data_smithi116_28801_object3092:head, will try copies on 2,3 2024-09-16T15:02:50.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.074+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:02:50.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.074+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b6977:::benchmark_data_smithi116_28801_object1305:head, will try copies on 0,4 2024-09-16T15:02:50.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.086+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6138c4cf:::benchmark_data_smithi116_28801_object3995:head, will try copies on 3,4 2024-09-16T15:02:50.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.114+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c009a7e:::benchmark_data_smithi116_28801_object2053:head, will try copies on 0,4 2024-09-16T15:02:50.143 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.138+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dda688d:::benchmark_data_smithi116_28801_object4062:head, will try copies on 3,4 2024-09-16T15:02:50.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.150+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97817846:::benchmark_data_smithi116_28801_object2817:head, will try copies on 0,4 2024-09-16T15:02:50.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.154+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516389eb:::benchmark_data_smithi116_28801_object2455:head, will try copies on 3,4 2024-09-16T15:02:50.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.178+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f78389:::benchmark_data_smithi116_28801_object3738:head, will try copies on 2,3 2024-09-16T15:02:50.195 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.190+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f7594c0:::benchmark_data_smithi116_28801_object2739:head, will try copies on 3,4 2024-09-16T15:02:50.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.262+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169df65:::benchmark_data_smithi116_28801_object3191:head, will try copies on 3,4 2024-09-16T15:02:50.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.290+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:02:50.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.294+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:02:50.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.302+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95278823:::benchmark_data_smithi116_28801_object3957:head, will try copies on 0,4 2024-09-16T15:02:50.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.318+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cb2f22:::benchmark_data_smithi116_28801_object553:head, will try copies on 3,4 2024-09-16T15:02:50.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.342+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929747b6:::benchmark_data_smithi116_28801_object2031:head, will try copies on 0,4 2024-09-16T15:02:50.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.342+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:02:50.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.346+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68591fea:::benchmark_data_smithi116_28801_object2792:head, will try copies on 3,4 2024-09-16T15:02:50.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.358+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d0daa8a:::benchmark_data_smithi116_28801_object1137:head, will try copies on 0,4 2024-09-16T15:02:50.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 352 15 3844317 3844302 682.524 624.25 0.00106125 0.00145529 2024-09-16T15:02:50.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.390+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:50.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.394+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:02:50.426 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.422+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:50.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.442+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e34de:::benchmark_data_smithi116_28801_object115:head, will try copies on 2,3 2024-09-16T15:02:50.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.450+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b16a7ad:::benchmark_data_smithi116_28801_object478:head, will try copies on 0,4 2024-09-16T15:02:50.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.466+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:02:50.490 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.486+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ac054:::benchmark_data_smithi116_28801_object1720:head, will try copies on 3,4 2024-09-16T15:02:50.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.494+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:02:50.511 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.506+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:02:50.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.518+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26671892:::benchmark_data_smithi116_28801_object1743:head, will try copies on 0,4 2024-09-16T15:02:50.538 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.534+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b421999c:::benchmark_data_smithi116_28801_object3506:head, will try copies on 2,3 2024-09-16T15:02:50.545 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.542+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9409e7cc:::benchmark_data_smithi116_28801_object2969:head, will try copies on 0,4 2024-09-16T15:02:50.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.554+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202e48c4:::benchmark_data_smithi116_28801_object2431:head, will try copies on 0,4 2024-09-16T15:02:50.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.554+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cb824b6:::benchmark_data_smithi116_28801_object3568:head, will try copies on 3,4 2024-09-16T15:02:50.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.570+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fb82d1:::benchmark_data_smithi116_28801_object3188:head, will try copies on 2,3 2024-09-16T15:02:50.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.578+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:929e0143:::benchmark_data_smithi116_28801_object126:head, will try copies on 0,4 2024-09-16T15:02:50.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.594+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:264c9c79:::benchmark_data_smithi116_28801_object978:head, will try copies on 0,4 2024-09-16T15:02:50.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.618+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed0d682:::benchmark_data_smithi116_28801_object537:head, will try copies on 0,4 2024-09-16T15:02:50.623 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.618+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd23a9c6:::benchmark_data_smithi116_28801_object2304:head, will try copies on 2,3 2024-09-16T15:02:50.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.630+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d10c9d1:::benchmark_data_smithi116_28801_object4064:head, will try copies on 3,4 2024-09-16T15:02:50.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.642+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:999c9132:::benchmark_data_smithi116_28801_object2359:head, will try copies on 0,4 2024-09-16T15:02:50.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.662+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T15:02:50.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.682+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e177ed0:::benchmark_data_smithi116_28801_object279:head, will try copies on 3,4 2024-09-16T15:02:50.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.718+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a243ddf:::benchmark_data_smithi116_28801_object3999:head, will try copies on 3,4 2024-09-16T15:02:50.721 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.718+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:02:50.731 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.726+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:959e709b:::benchmark_data_smithi116_28801_object1047:head, will try copies on 0,4 2024-09-16T15:02:50.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.734+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d847cf:::benchmark_data_smithi116_28801_object190:head, will try copies on 0,4 2024-09-16T15:02:50.748 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.742+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:534272d5:::benchmark_data_smithi116_28801_object4074:head, will try copies on 3,4 2024-09-16T15:02:50.765 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.762+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:02:50.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.782+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23ca0ae6:::benchmark_data_smithi116_28801_object3756:head, will try copies on 0,4 2024-09-16T15:02:50.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.802+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a3cb0a:::benchmark_data_smithi116_28801_object407:head, will try copies on 3,4 2024-09-16T15:02:50.810 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.806+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:02:50.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.806+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a4a2a3:::benchmark_data_smithi116_28801_object3978:head, will try copies on 3,4 2024-09-16T15:02:50.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.846+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:577a3523:::benchmark_data_smithi116_28801_object3104:head, will try copies on 3,4 2024-09-16T15:02:50.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.862+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:02:50.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.866+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:50.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.882+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68ae2437:::benchmark_data_smithi116_28801_object3473:head, will try copies on 3,4 2024-09-16T15:02:50.896 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.890+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c198753:::benchmark_data_smithi116_28801_object2456:head, will try copies on 0,4 2024-09-16T15:02:50.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.906+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:02:50.917 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.914+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4800aa5:::benchmark_data_smithi116_28801_object2591:head, will try copies on 2,3 2024-09-16T15:02:50.925 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.922+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:02:50.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.942+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c1fd75:::benchmark_data_smithi116_28801_object2246:head, will try copies on 3,4 2024-09-16T15:02:50.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.966+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:02:50.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.966+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:50.998 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.994+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ff53b94:::benchmark_data_smithi116_28801_object1875:head, will try copies on 3,4 2024-09-16T15:02:50.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97d29276:::benchmark_data_smithi116_28801_object2786:head, will try copies on 0,4 2024-09-16T15:02:51.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:50.998+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba4e0e25:::benchmark_data_smithi116_28801_object3235:head, will try copies on 2,3 2024-09-16T15:02:51.024 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.018+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b707c2ac:::benchmark_data_smithi116_28801_object321:head, will try copies on 2,3 2024-09-16T15:02:51.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.022+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21136a94:::benchmark_data_smithi116_28801_object4018:head, will try copies on 0,4 2024-09-16T15:02:51.033 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.030+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec766dd:::benchmark_data_smithi116_28801_object179:head, will try copies on 3,4 2024-09-16T15:02:51.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.030+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:652eddc9:::benchmark_data_smithi116_28801_object3720:head, will try copies on 3,4 2024-09-16T15:02:51.049 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.046+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9260e6eb:::benchmark_data_smithi116_28801_object2094:head, will try copies on 0,4 2024-09-16T15:02:51.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.074+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509b5c93:::benchmark_data_smithi116_28801_object797:head, will try copies on 3,4 2024-09-16T15:02:51.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.090+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695d21f7:::benchmark_data_smithi116_28801_object2870:head, will try copies on 3,4 2024-09-16T15:02:51.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.094+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:523b0991:::benchmark_data_smithi116_28801_object2521:head, will try copies on 3,4 2024-09-16T15:02:51.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.114+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:642f2cc8:::benchmark_data_smithi116_28801_object574:head, will try copies on 3,4 2024-09-16T15:02:51.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.122+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be787604:::benchmark_data_smithi116_28801_object1782:head, will try copies on 2,3 2024-09-16T15:02:51.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.122+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:51.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.142+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:02:51.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.150+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a3be6:::benchmark_data_smithi116_28801_object866:head, will try copies on 3,4 2024-09-16T15:02:51.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.166+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68d22c63:::benchmark_data_smithi116_28801_object223:head, will try copies on 3,4 2024-09-16T15:02:51.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.178+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9227fbec:::benchmark_data_smithi116_28801_object1897:head, will try copies on 0,4 2024-09-16T15:02:51.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.218+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98ed05cc:::benchmark_data_smithi116_28801_object3258:head, will try copies on 0,4 2024-09-16T15:02:51.251 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.246+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T15:02:51.252 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.246+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d19cc3:::benchmark_data_smithi116_28801_object3754:head, will try copies on 2,3 2024-09-16T15:02:51.275 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.270+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9643669d:::benchmark_data_smithi116_28801_object3276:head, will try copies on 0,4 2024-09-16T15:02:51.285 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.282+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579fb4a7:::benchmark_data_smithi116_28801_object1667:head, will try copies on 3,4 2024-09-16T15:02:51.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.286+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:02:51.321 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.318+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53bc2a9a:::benchmark_data_smithi116_28801_object2470:head, will try copies on 3,4 2024-09-16T15:02:51.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.334+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:02:51.339 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.334+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb777fd:::benchmark_data_smithi116_28801_object2637:head, will try copies on 0,4 2024-09-16T15:02:51.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.362+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68801878:::benchmark_data_smithi116_28801_object469:head, will try copies on 3,4 2024-09-16T15:02:51.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 353 16 3855373 3855357 682.547 690.938 0.000841693 0.00145526 2024-09-16T15:02:51.405 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.402+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21422dde:::benchmark_data_smithi116_28801_object1686:head, will try copies on 0,4 2024-09-16T15:02:51.433 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.430+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:02:51.435 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.430+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf95016:::benchmark_data_smithi116_28801_object2546:head, will try copies on 0,4 2024-09-16T15:02:51.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.446+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:02:51.485 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.482+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:02:51.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.494+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60387031:::benchmark_data_smithi116_28801_object3147:head, will try copies on 3,4 2024-09-16T15:02:51.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.498+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:02:51.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.518+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f9a637f:::benchmark_data_smithi116_28801_object2569:head, will try copies on 0,4 2024-09-16T15:02:51.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.526+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba75011d:::benchmark_data_smithi116_28801_object3923:head, will try copies on 2,3 2024-09-16T15:02:51.546 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.542+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ae2939e:::benchmark_data_smithi116_28801_object2059:head, will try copies on 0,4 2024-09-16T15:02:51.552 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.546+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670339c9:::benchmark_data_smithi116_28801_object1272:head, will try copies on 3,4 2024-09-16T15:02:51.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.550+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd76b1a:::benchmark_data_smithi116_28801_object327:head, will try copies on 2,3 2024-09-16T15:02:51.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.562+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52c0c6ee:::benchmark_data_smithi116_28801_object2747:head, will try copies on 3,4 2024-09-16T15:02:51.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.602+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa69a4e:::benchmark_data_smithi116_28801_object2119:head, will try copies on 3,4 2024-09-16T15:02:51.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.622+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b688d94:::benchmark_data_smithi116_28801_object1597:head, will try copies on 0,4 2024-09-16T15:02:51.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.630+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfb677d2:::benchmark_data_smithi116_28801_object690:head, will try copies on 2,3 2024-09-16T15:02:51.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.646+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d8b052:::benchmark_data_smithi116_28801_object13:head, will try copies on 3,4 2024-09-16T15:02:51.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.666+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3a398d6:::benchmark_data_smithi116_28801_object1352:head, will try copies on 2,3 2024-09-16T15:02:51.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.686+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:02:51.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.686+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:02:51.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.686+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:51.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.690+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b694edb:::benchmark_data_smithi116_28801_object1143:head, will try copies on 0,4 2024-09-16T15:02:51.756 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.750+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:02:51.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.754+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a91d75:::benchmark_data_smithi116_28801_object809:head, will try copies on 3,4 2024-09-16T15:02:51.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.762+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c84f076:::benchmark_data_smithi116_28801_object1197:head, will try copies on 0,4 2024-09-16T15:02:51.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.782+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:02:51.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.810+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb6396c:::benchmark_data_smithi116_28801_object3803:head, will try copies on 3,4 2024-09-16T15:02:51.819 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.814+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9606355f:::benchmark_data_smithi116_28801_object2554:head, will try copies on 0,4 2024-09-16T15:02:51.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.822+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5574d75f:::benchmark_data_smithi116_28801_object2853:head, will try copies on 3,4 2024-09-16T15:02:51.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.826+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6b4a93b:::benchmark_data_smithi116_28801_object401:head, will try copies on 2,3 2024-09-16T15:02:51.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.846+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:02:51.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.870+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9acf1216:::benchmark_data_smithi116_28801_object2065:head, will try copies on 0,4 2024-09-16T15:02:51.887 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.882+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1c0606:::benchmark_data_smithi116_28801_object3713:head, will try copies on 3,4 2024-09-16T15:02:51.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.894+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69931de0:::benchmark_data_smithi116_28801_object3740:head, will try copies on 3,4 2024-09-16T15:02:51.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.914+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509224e2:::benchmark_data_smithi116_28801_object503:head, will try copies on 3,4 2024-09-16T15:02:51.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.978+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fe7d6bd:::benchmark_data_smithi116_28801_object1323:head, will try copies on 0,4 2024-09-16T15:02:52.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.994+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61b57e78:::benchmark_data_smithi116_28801_object2568:head, will try copies on 3,4 2024-09-16T15:02:52.003 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:51.998+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:961bc461:::benchmark_data_smithi116_28801_object1583:head, will try copies on 0,4 2024-09-16T15:02:52.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.034+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:52.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.038+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:52.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.058+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:02:52.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.066+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdbcbdb1:::benchmark_data_smithi116_28801_object3159:head, will try copies on 2,3 2024-09-16T15:02:52.078 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.074+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:02:52.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.094+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9163017b:::benchmark_data_smithi116_28801_object733:head, will try copies on 0,4 2024-09-16T15:02:52.105 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.102+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244e081a:::benchmark_data_smithi116_28801_object465:head, will try copies on 0,4 2024-09-16T15:02:52.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.154+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:52.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.174+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:02:52.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.178+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2007f025:::benchmark_data_smithi116_28801_object2601:head, will try copies on 0,4 2024-09-16T15:02:52.182 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.178+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:02:52.190 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.186+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:02:52.204 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.198+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:02:52.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.226+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de30430:::benchmark_data_smithi116_28801_object2200:head, will try copies on 3,4 2024-09-16T15:02:52.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.254+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427260d:::benchmark_data_smithi116_28801_object3133:head, will try copies on 0,4 2024-09-16T15:02:52.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.266+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:02:52.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.274+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:212df20c:::benchmark_data_smithi116_28801_object2923:head, will try copies on 0,4 2024-09-16T15:02:52.291 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.286+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f3abb0:::benchmark_data_smithi116_28801_object2348:head, will try copies on 0,4 2024-09-16T15:02:52.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.302+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7eba71:::benchmark_data_smithi116_28801_object193:head, will try copies on 3,4 2024-09-16T15:02:52.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.318+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68e8cf83:::benchmark_data_smithi116_28801_object4026:head, will try copies on 3,4 2024-09-16T15:02:52.352 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.346+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98089f22:::benchmark_data_smithi116_28801_object2675:head, will try copies on 0,4 2024-09-16T15:02:52.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.370+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d9d32d2:::benchmark_data_smithi116_28801_object2378:head, will try copies on 0,4 2024-09-16T15:02:52.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 354 16 3866015 3865999 682.498 665.125 0.00183359 0.00145536 2024-09-16T15:02:52.402 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.398+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:02:52.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.410+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd0b355c:::benchmark_data_smithi116_28801_object1738:head, will try copies on 2,3 2024-09-16T15:02:52.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.438+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94d1c33e:::benchmark_data_smithi116_28801_object2130:head, will try copies on 0,4 2024-09-16T15:02:52.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.458+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:02:52.475 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.470+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aa0a9d0:::benchmark_data_smithi116_28801_object2498:head, will try copies on 0,4 2024-09-16T15:02:52.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.474+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:52.492 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.486+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:02:52.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.518+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be77ca60:::benchmark_data_smithi116_28801_object3718:head, will try copies on 2,3 2024-09-16T15:02:52.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.522+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:02:52.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.534+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1576c3e:::benchmark_data_smithi116_28801_object3239:head, will try copies on 2,3 2024-09-16T15:02:52.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.550+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:02:52.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.554+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:02:52.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.574+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ecb6c1c:::benchmark_data_smithi116_28801_object2418:head, will try copies on 0,4 2024-09-16T15:02:52.577 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.574+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:02:52.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.578+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:02:52.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.594+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:02:52.609 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.606+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:02:52.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.626+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91546ce1:::benchmark_data_smithi116_28801_object2917:head, will try copies on 0,4 2024-09-16T15:02:52.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.658+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c4b1ad3:::benchmark_data_smithi116_28801_object3937:head, will try copies on 3,4 2024-09-16T15:02:52.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.666+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8055725:::benchmark_data_smithi116_28801_object2740:head, will try copies on 2,3 2024-09-16T15:02:52.691 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.686+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:02:52.693 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.690+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:02:52.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.702+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bcfa7c:::benchmark_data_smithi116_28801_object3703:head, will try copies on 3,4 2024-09-16T15:02:52.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.702+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:02:52.708 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.702+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bef72293:::benchmark_data_smithi116_28801_object1198:head, will try copies on 2,3 2024-09-16T15:02:52.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.746+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27d8f496:::benchmark_data_smithi116_28801_object691:head, will try copies on 0,4 2024-09-16T15:02:52.759 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.754+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c066b:::benchmark_data_smithi116_28801_object653:head, will try copies on 3,4 2024-09-16T15:02:52.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.762+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T15:02:52.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.766+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:52.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.778+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7b2be22:::benchmark_data_smithi116_28801_object3038:head, will try copies on 2,3 2024-09-16T15:02:52.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.794+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c7467e:::benchmark_data_smithi116_28801_object159:head, will try copies on 3,4 2024-09-16T15:02:52.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.806+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99ea7308:::benchmark_data_smithi116_28801_object1085:head, will try copies on 0,4 2024-09-16T15:02:52.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.818+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26b3e197:::benchmark_data_smithi116_28801_object3439:head, will try copies on 0,4 2024-09-16T15:02:52.851 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.846+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8a80607:::benchmark_data_smithi116_28801_object930:head, will try copies on 2,3 2024-09-16T15:02:52.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.858+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c1c5317:::benchmark_data_smithi116_28801_object4041:head, will try copies on 0,4 2024-09-16T15:02:52.874 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.870+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:02:52.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.874+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:02:52.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.886+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9892aa8a:::benchmark_data_smithi116_28801_object2377:head, will try copies on 0,4 2024-09-16T15:02:52.918 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.914+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7d7e5f0:::benchmark_data_smithi116_28801_object14:head, will try copies on 2,3 2024-09-16T15:02:52.920 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.914+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:02:52.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.926+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca6deed:::benchmark_data_smithi116_28801_object2088:head, will try copies on 0,4 2024-09-16T15:02:52.955 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.950+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f6c8302:::benchmark_data_smithi116_28801_object1326:head, will try copies on 3,4 2024-09-16T15:02:52.968 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.962+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c9076c3:::benchmark_data_smithi116_28801_object1942:head, will try copies on 0,4 2024-09-16T15:02:52.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.966+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:02:52.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.982+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2441303b:::benchmark_data_smithi116_28801_object492:head, will try copies on 0,4 2024-09-16T15:02:52.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.994+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bab30ab2:::benchmark_data_smithi116_28801_object1703:head, will try copies on 2,3 2024-09-16T15:02:52.997 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:52.994+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63742686:::benchmark_data_smithi116_28801_object759:head, will try copies on 3,4 2024-09-16T15:02:53.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.002+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a136a0:::benchmark_data_smithi116_28801_object3596:head, will try copies on 3,4 2024-09-16T15:02:53.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.018+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2867faf0:::benchmark_data_smithi116_28801_object872:head, will try copies on 0,4 2024-09-16T15:02:53.023 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.018+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:02:53.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.058+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:02:53.085 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.082+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:02:53.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.086+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2209685f:::benchmark_data_smithi116_28801_object2058:head, will try copies on 0,4 2024-09-16T15:02:53.111 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.106+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:02:53.112 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.106+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e2bd89:::benchmark_data_smithi116_28801_object665:head, will try copies on 2,3 2024-09-16T15:02:53.122 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.118+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20af62a4:::benchmark_data_smithi116_28801_object648:head, will try copies on 0,4 2024-09-16T15:02:53.147 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.142+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:02:53.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.154+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f0288d:::benchmark_data_smithi116_28801_object1201:head, will try copies on 0,4 2024-09-16T15:02:53.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.162+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29558e4f:::benchmark_data_smithi116_28801_object2484:head, will try copies on 0,4 2024-09-16T15:02:53.177 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.174+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:02:53.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.178+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5f714e:::benchmark_data_smithi116_28801_object3437:head, will try copies on 2,3 2024-09-16T15:02:53.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.206+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c53883b:::benchmark_data_smithi116_28801_object3296:head, will try copies on 0,4 2024-09-16T15:02:53.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.214+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ef583e:::benchmark_data_smithi116_28801_object3196:head, will try copies on 0,4 2024-09-16T15:02:53.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.242+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b532ce2f:::benchmark_data_smithi116_28801_object1486:head, will try copies on 2,3 2024-09-16T15:02:53.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.242+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2531aa2b:::benchmark_data_smithi116_28801_object1808:head, will try copies on 0,4 2024-09-16T15:02:53.260 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.254+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62844357:::benchmark_data_smithi116_28801_object556:head, will try copies on 3,4 2024-09-16T15:02:53.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.258+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5088729e:::benchmark_data_smithi116_28801_object2462:head, will try copies on 3,4 2024-09-16T15:02:53.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.270+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T15:02:53.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.278+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a713f48:::benchmark_data_smithi116_28801_object1134:head, will try copies on 3,4 2024-09-16T15:02:53.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.278+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aaa411f:::benchmark_data_smithi116_28801_object1683:head, will try copies on 0,4 2024-09-16T15:02:53.311 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.306+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd71f779:::benchmark_data_smithi116_28801_object1330:head, will try copies on 2,3 2024-09-16T15:02:53.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.314+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58d16b7b:::benchmark_data_smithi116_28801_object625:head, will try copies on 3,4 2024-09-16T15:02:53.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.330+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99845e25:::benchmark_data_smithi116_28801_object1996:head, will try copies on 0,4 2024-09-16T15:02:53.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.338+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:02:53.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.362+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c075af:::benchmark_data_smithi116_28801_object3778:head, will try copies on 3,4 2024-09-16T15:02:53.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.374+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59fd01ed:::benchmark_data_smithi116_28801_object2125:head, will try copies on 3,4 2024-09-16T15:02:53.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 355 16 3877007 3876991 682.511 687 0.0022676 0.00145532 2024-09-16T15:02:53.388 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.382+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd06f71d:::benchmark_data_smithi116_28801_object2143:head, will try copies on 2,3 2024-09-16T15:02:53.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.394+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d4c120:::benchmark_data_smithi116_28801_object1472:head, will try copies on 0,4 2024-09-16T15:02:53.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.426+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971f72c4:::benchmark_data_smithi116_28801_object1793:head, will try copies on 0,4 2024-09-16T15:02:53.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.434+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aced76:::benchmark_data_smithi116_28801_object785:head, will try copies on 3,4 2024-09-16T15:02:53.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.458+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97439dee:::benchmark_data_smithi116_28801_object1533:head, will try copies on 0,4 2024-09-16T15:02:53.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.478+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ec1ae7:::benchmark_data_smithi116_28801_object2511:head, will try copies on 0,4 2024-09-16T15:02:53.494 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.490+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91f2b3f3:::benchmark_data_smithi116_28801_object3354:head, will try copies on 0,4 2024-09-16T15:02:53.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.506+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585b716c:::benchmark_data_smithi116_28801_object16:head, will try copies on 3,4 2024-09-16T15:02:53.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.514+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:02:53.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.546+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d2f2e8:::benchmark_data_smithi116_28801_object1094:head, will try copies on 3,4 2024-09-16T15:02:53.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.566+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:02:53.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.570+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:53.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.578+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad916dd:::benchmark_data_smithi116_28801_object2918:head, will try copies on 0,4 2024-09-16T15:02:53.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.578+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65d64af0:::benchmark_data_smithi116_28801_object1785:head, will try copies on 3,4 2024-09-16T15:02:53.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.602+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:02:53.627 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.622+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980a6dbf:::benchmark_data_smithi116_28801_object2887:head, will try copies on 0,4 2024-09-16T15:02:53.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.626+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8005f79:::benchmark_data_smithi116_28801_object3004:head, will try copies on 2,3 2024-09-16T15:02:53.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.642+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:02:53.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.658+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93848a6e:::benchmark_data_smithi116_28801_object2982:head, will try copies on 0,4 2024-09-16T15:02:53.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.666+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21255f68:::benchmark_data_smithi116_28801_object2902:head, will try copies on 0,4 2024-09-16T15:02:53.709 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.706+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59051b1b:::benchmark_data_smithi116_28801_object2522:head, will try copies on 3,4 2024-09-16T15:02:53.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.706+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b443493e:::benchmark_data_smithi116_28801_object1645:head, will try copies on 2,3 2024-09-16T15:02:53.710 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.706+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2e2c87:::benchmark_data_smithi116_28801_object94:head, will try copies on 0,4 2024-09-16T15:02:53.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.722+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:678b660c:::benchmark_data_smithi116_28801_object1974:head, will try copies on 3,4 2024-09-16T15:02:53.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.746+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd078b:::benchmark_data_smithi116_28801_object1380:head, will try copies on 2,3 2024-09-16T15:02:53.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.766+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee116eb:::benchmark_data_smithi116_28801_object1011:head, will try copies on 0,4 2024-09-16T15:02:53.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.770+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28b1035f:::benchmark_data_smithi116_28801_object2922:head, will try copies on 0,4 2024-09-16T15:02:53.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.790+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:02:53.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.806+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:286b3ade:::benchmark_data_smithi116_28801_object3200:head, will try copies on 0,4 2024-09-16T15:02:53.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.842+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830277:::benchmark_data_smithi116_28801_object1395:head, will try copies on 0,4 2024-09-16T15:02:53.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.870+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:02:53.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.886+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb8c14c:::benchmark_data_smithi116_28801_object3246:head, will try copies on 0,4 2024-09-16T15:02:53.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.910+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe93bed:::benchmark_data_smithi116_28801_object2879:head, will try copies on 3,4 2024-09-16T15:02:53.913 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.910+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:665393b1:::benchmark_data_smithi116_28801_object210:head, will try copies on 3,4 2024-09-16T15:02:53.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.946+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aee384:::benchmark_data_smithi116_28801_object2283:head, will try copies on 3,4 2024-09-16T15:02:53.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.962+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:521f7bc0:::benchmark_data_smithi116_28801_object3347:head, will try copies on 3,4 2024-09-16T15:02:53.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.962+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b523486f:::benchmark_data_smithi116_28801_object3110:head, will try copies on 2,3 2024-09-16T15:02:53.966 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.962+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f91154:::benchmark_data_smithi116_28801_object907:head, will try copies on 0,4 2024-09-16T15:02:53.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.978+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:02:53.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:53.994+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d4705f4:::benchmark_data_smithi116_28801_object3938:head, will try copies on 0,4 2024-09-16T15:02:54.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.010+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T15:02:54.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.038+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe46bb4:::benchmark_data_smithi116_28801_object201:head, will try copies on 3,4 2024-09-16T15:02:54.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.082+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:02:54.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.086+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:02:54.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.090+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:02:54.113 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.110+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecc0e6c:::benchmark_data_smithi116_28801_object2018:head, will try copies on 0,4 2024-09-16T15:02:54.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.114+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f47bf91:::benchmark_data_smithi116_28801_object372:head, will try copies on 0,4 2024-09-16T15:02:54.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.130+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6903c124:::benchmark_data_smithi116_28801_object1724:head, will try copies on 3,4 2024-09-16T15:02:54.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.138+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b8348:::benchmark_data_smithi116_28801_object215:head, will try copies on 2,3 2024-09-16T15:02:54.164 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.158+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fdce457:::benchmark_data_smithi116_28801_object3901:head, will try copies on 3,4 2024-09-16T15:02:54.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.166+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:02:54.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.178+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a9b2741:::benchmark_data_smithi116_28801_object3015:head, will try copies on 3,4 2024-09-16T15:02:54.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.190+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7a59d6a:::benchmark_data_smithi116_28801_object3499:head, will try copies on 2,3 2024-09-16T15:02:54.217 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.214+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be190055:::benchmark_data_smithi116_28801_object2426:head, will try copies on 2,3 2024-09-16T15:02:54.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.222+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:02:54.248 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.242+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b97538:::benchmark_data_smithi116_28801_object2598:head, will try copies on 0,4 2024-09-16T15:02:54.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.270+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdd542c2:::benchmark_data_smithi116_28801_object269:head, will try copies on 2,3 2024-09-16T15:02:54.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.278+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0e79a2:::benchmark_data_smithi116_28801_object1818:head, will try copies on 3,4 2024-09-16T15:02:54.292 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.286+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f355f8b:::benchmark_data_smithi116_28801_object2610:head, will try copies on 0,4 2024-09-16T15:02:54.307 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.302+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:02:54.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.306+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d4715c2:::benchmark_data_smithi116_28801_object2929:head, will try copies on 3,4 2024-09-16T15:02:54.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.322+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ae3e9e0:::benchmark_data_smithi116_28801_object339:head, will try copies on 0,4 2024-09-16T15:02:54.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.326+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b30db1:::benchmark_data_smithi116_28801_object3784:head, will try copies on 0,4 2024-09-16T15:02:54.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.330+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba94bad4:::benchmark_data_smithi116_28801_object1086:head, will try copies on 2,3 2024-09-16T15:02:54.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.366+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67da5c63:::benchmark_data_smithi116_28801_object3430:head, will try copies on 3,4 2024-09-16T15:02:54.380 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.374+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e362fb:::benchmark_data_smithi116_28801_object3363:head, will try copies on 3,4 2024-09-16T15:02:54.384 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 356 16 3888545 3888529 682.619 721.125 0.00114226 0.0014551 2024-09-16T15:02:54.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.398+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9156aeae:::benchmark_data_smithi116_28801_object89:head, will try copies on 0,4 2024-09-16T15:02:54.412 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.406+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:02:54.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.442+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8d6a0e:::benchmark_data_smithi116_28801_object1434:head, will try copies on 3,4 2024-09-16T15:02:54.463 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.458+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:02:54.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.462+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67906414:::benchmark_data_smithi116_28801_object3229:head, will try copies on 3,4 2024-09-16T15:02:54.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.474+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d8d0aaa:::benchmark_data_smithi116_28801_object3475:head, will try copies on 3,4 2024-09-16T15:02:54.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.478+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e149207:::benchmark_data_smithi116_28801_object8:head, will try copies on 0,4 2024-09-16T15:02:54.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.506+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:02:54.519 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.514+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5eabc3ee:::benchmark_data_smithi116_28801_object2220:head, will try copies on 3,4 2024-09-16T15:02:54.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.530+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5903ef9:::benchmark_data_smithi116_28801_object1266:head, will try copies on 2,3 2024-09-16T15:02:54.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.542+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cedf3d2:::benchmark_data_smithi116_28801_object3594:head, will try copies on 3,4 2024-09-16T15:02:54.551 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.546+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:02:54.565 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.562+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d6939:::benchmark_data_smithi116_28801_object2134:head, will try copies on 2,3 2024-09-16T15:02:54.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.590+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:254a5583:::benchmark_data_smithi116_28801_object3986:head, will try copies on 0,4 2024-09-16T15:02:54.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.626+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5396f4a8:::benchmark_data_smithi116_28801_object3675:head, will try copies on 3,4 2024-09-16T15:02:54.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e39cd8b:::benchmark_data_smithi116_28801_object629:head, will try copies on 0,4 2024-09-16T15:02:54.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.630+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93a8df60:::benchmark_data_smithi116_28801_object103:head, will try copies on 0,4 2024-09-16T15:02:54.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.638+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbeed45f:::benchmark_data_smithi116_28801_object5:head, will try copies on 2,3 2024-09-16T15:02:54.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.638+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:54.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.650+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59b27868:::benchmark_data_smithi116_28801_object290:head, will try copies on 3,4 2024-09-16T15:02:54.658 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.654+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25b06790:::benchmark_data_smithi116_28801_object2366:head, will try copies on 0,4 2024-09-16T15:02:54.698 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.694+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e8c105f:::benchmark_data_smithi116_28801_object3405:head, will try copies on 3,4 2024-09-16T15:02:54.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.702+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:987eaeed:::benchmark_data_smithi116_28801_object3289:head, will try copies on 0,4 2024-09-16T15:02:54.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.702+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b602c81f:::benchmark_data_smithi116_28801_object4045:head, will try copies on 2,3 2024-09-16T15:02:54.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.742+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d5cf32:::benchmark_data_smithi116_28801_object2195:head, will try copies on 2,3 2024-09-16T15:02:54.763 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.758+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf4893:::benchmark_data_smithi116_28801_object460:head, will try copies on 3,4 2024-09-16T15:02:54.788 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.782+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2705a4ed:::benchmark_data_smithi116_28801_object4067:head, will try copies on 0,4 2024-09-16T15:02:54.789 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.786+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ce58a2:::benchmark_data_smithi116_28801_object338:head, will try copies on 3,4 2024-09-16T15:02:54.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.802+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbea8eb:::benchmark_data_smithi116_28801_object3858:head, will try copies on 3,4 2024-09-16T15:02:54.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.842+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2bd68b6:::benchmark_data_smithi116_28801_object1078:head, will try copies on 2,3 2024-09-16T15:02:54.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.846+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:54.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.866+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:02:54.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.874+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:295a3226:::benchmark_data_smithi116_28801_object2506:head, will try copies on 0,4 2024-09-16T15:02:54.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d6c313:::benchmark_data_smithi116_28801_object2396:head, will try copies on 2,3 2024-09-16T15:02:54.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.894+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c50be82:::benchmark_data_smithi116_28801_object3988:head, will try copies on 3,4 2024-09-16T15:02:54.931 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.926+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58dce9ba:::benchmark_data_smithi116_28801_object2927:head, will try copies on 3,4 2024-09-16T15:02:54.932 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.926+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f32ba04:::benchmark_data_smithi116_28801_object1569:head, will try copies on 0,4 2024-09-16T15:02:54.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.958+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:933b603c:::benchmark_data_smithi116_28801_object608:head, will try copies on 0,4 2024-09-16T15:02:54.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.958+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ea45e72:::benchmark_data_smithi116_28801_object3251:head, will try copies on 3,4 2024-09-16T15:02:54.988 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.986+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e0da001:::benchmark_data_smithi116_28801_object3241:head, will try copies on 0,4 2024-09-16T15:02:54.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.990+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6483e973:::benchmark_data_smithi116_28801_object3071:head, will try copies on 3,4 2024-09-16T15:02:54.994 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:54.990+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c168507:::benchmark_data_smithi116_28801_object795:head, will try copies on 3,4 2024-09-16T15:02:55.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.018+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:55.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.030+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b1629b:::benchmark_data_smithi116_28801_object1106:head, will try copies on 3,4 2024-09-16T15:02:55.034 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.030+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923a0e32:::benchmark_data_smithi116_28801_object1586:head, will try copies on 0,4 2024-09-16T15:02:55.059 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.054+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:558b02de:::benchmark_data_smithi116_28801_object835:head, will try copies on 3,4 2024-09-16T15:02:55.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.086+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc6a3920:::benchmark_data_smithi116_28801_object2636:head, will try copies on 2,3 2024-09-16T15:02:55.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.090+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:902d73e9:::benchmark_data_smithi116_28801_object2866:head, will try copies on 0,4 2024-09-16T15:02:55.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.110+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac973e9:::benchmark_data_smithi116_28801_object1236:head, will try copies on 3,4 2024-09-16T15:02:55.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.130+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a02e51:::benchmark_data_smithi116_28801_object1466:head, will try copies on 3,4 2024-09-16T15:02:55.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.150+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:02:55.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.158+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be25217:::benchmark_data_smithi116_28801_object1264:head, will try copies on 0,4 2024-09-16T15:02:55.169 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.166+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6eef87f:::benchmark_data_smithi116_28801_object2300:head, will try copies on 2,3 2024-09-16T15:02:55.175 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.170+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e6988c5:::benchmark_data_smithi116_28801_object3652:head, will try copies on 3,4 2024-09-16T15:02:55.198 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.194+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d16a56:::benchmark_data_smithi116_28801_object1217:head, will try copies on 0,4 2024-09-16T15:02:55.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.206+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2043256d:::benchmark_data_smithi116_28801_object1628:head, will try copies on 0,4 2024-09-16T15:02:55.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.218+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:593228bb:::benchmark_data_smithi116_28801_object1886:head, will try copies on 3,4 2024-09-16T15:02:55.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.218+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:02:55.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.254+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6155c161:::benchmark_data_smithi116_28801_object3360:head, will try copies on 3,4 2024-09-16T15:02:55.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.254+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3ee2b3:::benchmark_data_smithi116_28801_object1425:head, will try copies on 0,4 2024-09-16T15:02:55.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.262+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b534fb:::benchmark_data_smithi116_28801_object2424:head, will try copies on 3,4 2024-09-16T15:02:55.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.262+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b673c58a:::benchmark_data_smithi116_28801_object3910:head, will try copies on 2,3 2024-09-16T15:02:55.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.278+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6746ce77:::benchmark_data_smithi116_28801_object2478:head, will try copies on 3,4 2024-09-16T15:02:55.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.278+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:02:55.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.330+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e8d1a2:::benchmark_data_smithi116_28801_object1994:head, will try copies on 3,4 2024-09-16T15:02:55.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.342+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90828239:::benchmark_data_smithi116_28801_object2213:head, will try copies on 0,4 2024-09-16T15:02:55.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.350+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26781ca6:::benchmark_data_smithi116_28801_object2948:head, will try copies on 0,4 2024-09-16T15:02:55.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.350+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e0ca1b9:::benchmark_data_smithi116_28801_object1322:head, will try copies on 3,4 2024-09-16T15:02:55.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.358+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4ce6832:::benchmark_data_smithi116_28801_object2029:head, will try copies on 2,3 2024-09-16T15:02:55.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 357 16 3899730 3899714 682.665 699.062 0.000981772 0.00145499 2024-09-16T15:02:55.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.402+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:02:55.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.410+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61f3c887:::benchmark_data_smithi116_28801_object1312:head, will try copies on 3,4 2024-09-16T15:02:55.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.422+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:519315eb:::benchmark_data_smithi116_28801_object2495:head, will try copies on 3,4 2024-09-16T15:02:55.431 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.426+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:02:55.437 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.434+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22d04611:::benchmark_data_smithi116_28801_object2595:head, will try copies on 0,4 2024-09-16T15:02:55.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.438+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fd7fcc:::benchmark_data_smithi116_28801_object751:head, will try copies on 3,4 2024-09-16T15:02:55.446 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.442+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:972a485b:::benchmark_data_smithi116_28801_object3896:head, will try copies on 0,4 2024-09-16T15:02:55.505 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.502+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ea1e711:::benchmark_data_smithi116_28801_object214:head, will try copies on 3,4 2024-09-16T15:02:55.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.510+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbce98ff:::benchmark_data_smithi116_28801_object2638:head, will try copies on 2,3 2024-09-16T15:02:55.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.522+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:02:55.529 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.526+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4ab610:::benchmark_data_smithi116_28801_object3326:head, will try copies on 0,4 2024-09-16T15:02:55.541 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.534+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:02:55.557 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.554+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ca867cc:::benchmark_data_smithi116_28801_object805:head, will try copies on 0,4 2024-09-16T15:02:55.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.566+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ed48dfd:::benchmark_data_smithi116_28801_object1420:head, will try copies on 0,4 2024-09-16T15:02:55.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.574+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:02:55.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.578+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:02:55.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.630+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94355cc0:::benchmark_data_smithi116_28801_object4082:head, will try copies on 0,4 2024-09-16T15:02:55.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.634+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f5c516f:::benchmark_data_smithi116_28801_object1516:head, will try copies on 0,4 2024-09-16T15:02:55.651 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.646+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe57790:::benchmark_data_smithi116_28801_object61:head, will try copies on 0,4 2024-09-16T15:02:55.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.650+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:02:55.661 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.658+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:02:55.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.662+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc905c2:::benchmark_data_smithi116_28801_object3407:head, will try copies on 0,4 2024-09-16T15:02:55.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.674+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54356092:::benchmark_data_smithi116_28801_object2190:head, will try copies on 3,4 2024-09-16T15:02:55.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.698+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd9708f:::benchmark_data_smithi116_28801_object2859:head, will try copies on 3,4 2024-09-16T15:02:55.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.738+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce755e:::benchmark_data_smithi116_28801_object622:head, will try copies on 2,3 2024-09-16T15:02:55.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.742+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ea0dcd:::benchmark_data_smithi116_28801_object1609:head, will try copies on 3,4 2024-09-16T15:02:55.747 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d3aa30c:::benchmark_data_smithi116_28801_object3880:head, will try copies on 0,4 2024-09-16T15:02:55.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.766+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc3c417b:::benchmark_data_smithi116_28801_object1948:head, will try copies on 2,3 2024-09-16T15:02:55.781 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.778+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6047b376:::benchmark_data_smithi116_28801_object1810:head, will try copies on 3,4 2024-09-16T15:02:55.795 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.790+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cde28a2:::benchmark_data_smithi116_28801_object2183:head, will try copies on 0,4 2024-09-16T15:02:55.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.794+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:02:55.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.794+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64ec5fdb:::benchmark_data_smithi116_28801_object1493:head, will try copies on 3,4 2024-09-16T15:02:55.801 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.798+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:243fd79f:::benchmark_data_smithi116_28801_object1429:head, will try copies on 0,4 2024-09-16T15:02:55.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.846+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d7bf1b9:::benchmark_data_smithi116_28801_object3385:head, will try copies on 3,4 2024-09-16T15:02:55.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.854+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b25669e1:::benchmark_data_smithi116_28801_object474:head, will try copies on 2,3 2024-09-16T15:02:55.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.874+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6abe9d:::benchmark_data_smithi116_28801_object3883:head, will try copies on 3,4 2024-09-16T15:02:55.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.894+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b8ad02:::benchmark_data_smithi116_28801_object1183:head, will try copies on 2,3 2024-09-16T15:02:55.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.906+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:260db6ce:::benchmark_data_smithi116_28801_object370:head, will try copies on 0,4 2024-09-16T15:02:55.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.922+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985f6606:::benchmark_data_smithi116_28801_object1905:head, will try copies on 0,4 2024-09-16T15:02:55.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.934+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a7afef:::benchmark_data_smithi116_28801_object1276:head, will try copies on 0,4 2024-09-16T15:02:55.943 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.938+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e63e3cc:::benchmark_data_smithi116_28801_object3265:head, will try copies on 3,4 2024-09-16T15:02:55.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.970+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92414644:::benchmark_data_smithi116_28801_object3984:head, will try copies on 0,4 2024-09-16T15:02:55.981 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.978+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:674e5601:::benchmark_data_smithi116_28801_object1093:head, will try copies on 3,4 2024-09-16T15:02:55.986 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.982+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0c4983:::benchmark_data_smithi116_28801_object275:head, will try copies on 3,4 2024-09-16T15:02:56.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:55.998+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b5f6149:::benchmark_data_smithi116_28801_object456:head, will try copies on 0,4 2024-09-16T15:02:56.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.006+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29869ae3:::benchmark_data_smithi116_28801_object2266:head, will try copies on 0,4 2024-09-16T15:02:56.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.026+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fde6e37:::benchmark_data_smithi116_28801_object1952:head, will try copies on 0,4 2024-09-16T15:02:56.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.038+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23eadfa3:::benchmark_data_smithi116_28801_object2765:head, will try copies on 0,4 2024-09-16T15:02:56.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.054+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:02:56.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.054+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beeee3dc:::benchmark_data_smithi116_28801_object186:head, will try copies on 2,3 2024-09-16T15:02:56.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.062+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957622d1:::benchmark_data_smithi116_28801_object2724:head, will try copies on 0,4 2024-09-16T15:02:56.069 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.066+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3c6fd4:::benchmark_data_smithi116_28801_object2668:head, will try copies on 3,4 2024-09-16T15:02:56.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.086+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:56.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.114+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cc558a6:::benchmark_data_smithi116_28801_object3559:head, will try copies on 3,4 2024-09-16T15:02:56.135 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.130+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d37411a:::benchmark_data_smithi116_28801_object3120:head, will try copies on 3,4 2024-09-16T15:02:56.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.142+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272facb2:::benchmark_data_smithi116_28801_object1287:head, will try copies on 0,4 2024-09-16T15:02:56.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.146+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:02:56.165 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.162+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b2392c3:::benchmark_data_smithi116_28801_object3190:head, will try copies on 3,4 2024-09-16T15:02:56.173 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.170+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:505cfbf1:::benchmark_data_smithi116_28801_object969:head, will try copies on 3,4 2024-09-16T15:02:56.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.182+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:290cc084:::benchmark_data_smithi116_28801_object489:head, will try copies on 0,4 2024-09-16T15:02:56.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.218+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdc5ecb0:::benchmark_data_smithi116_28801_object3589:head, will try copies on 2,3 2024-09-16T15:02:56.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.222+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:600dd6dd:::benchmark_data_smithi116_28801_object957:head, will try copies on 3,4 2024-09-16T15:02:56.253 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.250+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53c977b:::benchmark_data_smithi116_28801_object1453:head, will try copies on 2,3 2024-09-16T15:02:56.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.262+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6021af6b:::benchmark_data_smithi116_28801_object2074:head, will try copies on 3,4 2024-09-16T15:02:56.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.274+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:925d69bc:::benchmark_data_smithi116_28801_object2350:head, will try copies on 0,4 2024-09-16T15:02:56.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.274+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c6b670:::benchmark_data_smithi116_28801_object3342:head, will try copies on 3,4 2024-09-16T15:02:56.296 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.290+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216cbb65:::benchmark_data_smithi116_28801_object395:head, will try copies on 0,4 2024-09-16T15:02:56.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.322+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5c1151:::benchmark_data_smithi116_28801_object43:head, will try copies on 2,3 2024-09-16T15:02:56.332 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.326+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bb2547:::benchmark_data_smithi116_28801_object559:head, will try copies on 3,4 2024-09-16T15:02:56.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.330+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eeb36df:::benchmark_data_smithi116_28801_object4000:head, will try copies on 0,4 2024-09-16T15:02:56.345 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.342+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777931:::benchmark_data_smithi116_28801_object2563:head, will try copies on 0,4 2024-09-16T15:02:56.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.350+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd34e9ae:::benchmark_data_smithi116_28801_object1045:head, will try copies on 2,3 2024-09-16T15:02:56.368 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.362+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57738538:::benchmark_data_smithi116_28801_object158:head, will try copies on 3,4 2024-09-16T15:02:56.369 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.366+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95bcb4c4:::benchmark_data_smithi116_28801_object1761:head, will try copies on 0,4 2024-09-16T15:02:56.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 358 16 3910727 3910711 682.678 687.312 0.000574395 0.00145497 2024-09-16T15:02:56.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.454+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:02:56.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.470+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5229a2cc:::benchmark_data_smithi116_28801_object3091:head, will try copies on 3,4 2024-09-16T15:02:56.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.478+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e131e28:::benchmark_data_smithi116_28801_object1860:head, will try copies on 0,4 2024-09-16T15:02:56.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.490+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6014cc0a:::benchmark_data_smithi116_28801_object3288:head, will try copies on 3,4 2024-09-16T15:02:56.495 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.490+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2101cfbe:::benchmark_data_smithi116_28801_object1452:head, will try copies on 0,4 2024-09-16T15:02:56.514 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.510+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfcc669:::benchmark_data_smithi116_28801_object2553:head, will try copies on 2,3 2024-09-16T15:02:56.534 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.530+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f0c73c:::benchmark_data_smithi116_28801_object1550:head, will try copies on 0,4 2024-09-16T15:02:56.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.534+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:02:56.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.538+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fffc498:::benchmark_data_smithi116_28801_object793:head, will try copies on 3,4 2024-09-16T15:02:56.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.566+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b77c92:::benchmark_data_smithi116_28801_object992:head, will try copies on 3,4 2024-09-16T15:02:56.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.594+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58280564:::benchmark_data_smithi116_28801_object1542:head, will try copies on 3,4 2024-09-16T15:02:56.603 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.598+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9794b09d:::benchmark_data_smithi116_28801_object2992:head, will try copies on 0,4 2024-09-16T15:02:56.616 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.610+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69f15e4e:::benchmark_data_smithi116_28801_object2689:head, will try copies on 3,4 2024-09-16T15:02:56.629 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.626+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e616f9:::benchmark_data_smithi116_28801_object3743:head, will try copies on 2,3 2024-09-16T15:02:56.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.642+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e156382:::benchmark_data_smithi116_28801_object2232:head, will try copies on 0,4 2024-09-16T15:02:56.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.678+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622e5aef:::benchmark_data_smithi116_28801_object715:head, will try copies on 3,4 2024-09-16T15:02:56.690 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.686+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:220dde04:::benchmark_data_smithi116_28801_object166:head, will try copies on 0,4 2024-09-16T15:02:56.694 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.690+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90d65c36:::benchmark_data_smithi116_28801_object439:head, will try copies on 0,4 2024-09-16T15:02:56.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.702+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5389c9e2:::benchmark_data_smithi116_28801_object2825:head, will try copies on 3,4 2024-09-16T15:02:56.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.702+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be5b3739:::benchmark_data_smithi116_28801_object2657:head, will try copies on 2,3 2024-09-16T15:02:56.745 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.742+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:585ea355:::benchmark_data_smithi116_28801_object1240:head, will try copies on 3,4 2024-09-16T15:02:56.749 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.746+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21aafc96:::benchmark_data_smithi116_28801_object1487:head, will try copies on 0,4 2024-09-16T15:02:56.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.754+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf631fb3:::benchmark_data_smithi116_28801_object2585:head, will try copies on 2,3 2024-09-16T15:02:56.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.758+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9016dc6e:::benchmark_data_smithi116_28801_object2335:head, will try copies on 0,4 2024-09-16T15:02:56.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.790+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a72b6:::benchmark_data_smithi116_28801_object2790:head, will try copies on 2,3 2024-09-16T15:02:56.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.802+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e48a97:::benchmark_data_smithi116_28801_object3068:head, will try copies on 3,4 2024-09-16T15:02:56.832 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.826+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f534db:::benchmark_data_smithi116_28801_object3476:head, will try copies on 3,4 2024-09-16T15:02:56.841 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.838+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f94b2b:::benchmark_data_smithi116_28801_object2408:head, will try copies on 0,4 2024-09-16T15:02:56.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.846+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb69f95:::benchmark_data_smithi116_28801_object3956:head, will try copies on 0,4 2024-09-16T15:02:56.869 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.866+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6d3:::benchmark_data_smithi116_28801_object2209:head, will try copies on 3,4 2024-09-16T15:02:56.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.882+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9758b6b:::benchmark_data_smithi116_28801_object4004:head, will try copies on 2,3 2024-09-16T15:02:56.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.886+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235df99e:::benchmark_data_smithi116_28801_object2744:head, will try copies on 0,4 2024-09-16T15:02:56.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.886+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b5017e:::benchmark_data_smithi116_28801_object1844:head, will try copies on 3,4 2024-09-16T15:02:56.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.898+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54006af9:::benchmark_data_smithi116_28801_object1131:head, will try copies on 3,4 2024-09-16T15:02:56.928 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.922+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc56340b:::benchmark_data_smithi116_28801_object2219:head, will try copies on 2,3 2024-09-16T15:02:56.944 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.938+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ce63f82:::benchmark_data_smithi116_28801_object1283:head, will try copies on 0,4 2024-09-16T15:02:56.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.950+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:551e3038:::benchmark_data_smithi116_28801_object3323:head, will try copies on 3,4 2024-09-16T15:02:56.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.970+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2990dfed:::benchmark_data_smithi116_28801_object448:head, will try copies on 0,4 2024-09-16T15:02:56.984 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.978+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50c5a022:::benchmark_data_smithi116_28801_object156:head, will try copies on 3,4 2024-09-16T15:02:56.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.990+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bd2fc7b:::benchmark_data_smithi116_28801_object2925:head, will try copies on 3,4 2024-09-16T15:02:57.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:56.994+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6957a1:::benchmark_data_smithi116_28801_object3940:head, will try copies on 2,3 2024-09-16T15:02:57.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.034+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6276cb26:::benchmark_data_smithi116_28801_object1706:head, will try copies on 3,4 2024-09-16T15:02:57.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.042+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58c29f19:::benchmark_data_smithi116_28801_object109:head, will try copies on 3,4 2024-09-16T15:02:57.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.062+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dca48ad:::benchmark_data_smithi116_28801_object2756:head, will try copies on 3,4 2024-09-16T15:02:57.067 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.062+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92a6d9e0:::benchmark_data_smithi116_28801_object2365:head, will try copies on 0,4 2024-09-16T15:02:57.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.066+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b093890c:::benchmark_data_smithi116_28801_object931:head, will try copies on 2,3 2024-09-16T15:02:57.108 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.102+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:597ff47b:::benchmark_data_smithi116_28801_object3402:head, will try copies on 3,4 2024-09-16T15:02:57.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.130+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691e39d0:::benchmark_data_smithi116_28801_object4107:head, will try copies on 3,4 2024-09-16T15:02:57.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.138+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bbfd066:::benchmark_data_smithi116_28801_object753:head, will try copies on 0,4 2024-09-16T15:02:57.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.158+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0ee27a7:::benchmark_data_smithi116_28801_object1029:head, will try copies on 2,3 2024-09-16T15:02:57.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.174+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22958d30:::benchmark_data_smithi116_28801_object1150:head, will try copies on 0,4 2024-09-16T15:02:57.184 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.178+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:904bbbc2:::benchmark_data_smithi116_28801_object3837:head, will try copies on 0,4 2024-09-16T15:02:57.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.214+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a79ecd:::benchmark_data_smithi116_28801_object346:head, will try copies on 3,4 2024-09-16T15:02:57.239 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.234+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ef71ee0:::benchmark_data_smithi116_28801_object830:head, will try copies on 0,4 2024-09-16T15:02:57.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.242+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bea2518:::benchmark_data_smithi116_28801_object1476:head, will try copies on 3,4 2024-09-16T15:02:57.259 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.254+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:02:57.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.258+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65993eb3:::benchmark_data_smithi116_28801_object1723:head, will try copies on 3,4 2024-09-16T15:02:57.290 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.286+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:02:57.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.310+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fb0c67e:::benchmark_data_smithi116_28801_object1445:head, will try copies on 3,4 2024-09-16T15:02:57.318 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.314+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6b28de:::benchmark_data_smithi116_28801_object965:head, will try copies on 0,4 2024-09-16T15:02:57.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.322+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b6084:::benchmark_data_smithi116_28801_object2618:head, will try copies on 2,3 2024-09-16T15:02:57.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.326+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b8adf9f:::benchmark_data_smithi116_28801_object1158:head, will try copies on 3,4 2024-09-16T15:02:57.340 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.334+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261baa71:::benchmark_data_smithi116_28801_object3300:head, will try copies on 0,4 2024-09-16T15:02:57.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.354+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93e73598:::benchmark_data_smithi116_28801_object3252:head, will try copies on 0,4 2024-09-16T15:02:57.367 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.362+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58faf086:::benchmark_data_smithi116_28801_object1012:head, will try copies on 3,4 2024-09-16T15:02:57.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout: 359 16 3921913 3921897 682.723 699.125 0.00222621 0.00145488 2024-09-16T15:02:57.390 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.386+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:badd74bd:::benchmark_data_smithi116_28801_object1697:head, will try copies on 2,3 2024-09-16T15:02:57.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.406+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e8adab3:::benchmark_data_smithi116_28801_object2926:head, will try copies on 3,4 2024-09-16T15:02:57.427 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.422+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bff66b82:::benchmark_data_smithi116_28801_object3583:head, will try copies on 2,3 2024-09-16T15:02:57.441 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.438+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d1872b7:::benchmark_data_smithi116_28801_object1903:head, will try copies on 3,4 2024-09-16T15:02:57.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.446+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baba2c0a:::benchmark_data_smithi116_28801_object569:head, will try copies on 2,3 2024-09-16T15:02:57.449 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.446+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25550f1d:::benchmark_data_smithi116_28801_object3414:head, will try copies on 0,4 2024-09-16T15:02:57.462 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.458+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9019ccd3:::benchmark_data_smithi116_28801_object1107:head, will try copies on 0,4 2024-09-16T15:02:57.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.498+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf98d0e6:::benchmark_data_smithi116_28801_object2507:head, will try copies on 2,3 2024-09-16T15:02:57.521 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.518+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbefe89f:::benchmark_data_smithi116_28801_object620:head, will try copies on 2,3 2024-09-16T15:02:57.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.518+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d0c4d2:::benchmark_data_smithi116_28801_object441:head, will try copies on 0,4 2024-09-16T15:02:57.525 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.522+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5248b2af:::benchmark_data_smithi116_28801_object4012:head, will try copies on 3,4 2024-09-16T15:02:57.549 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.546+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7ab0b3c:::benchmark_data_smithi116_28801_object2193:head, will try copies on 2,3 2024-09-16T15:02:57.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.570+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aef78c3:::benchmark_data_smithi116_28801_object2502:head, will try copies on 3,4 2024-09-16T15:02:57.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.582+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b72f145:::benchmark_data_smithi116_28801_object561:head, will try copies on 0,4 2024-09-16T15:02:57.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.590+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fecdf6:::benchmark_data_smithi116_28801_object1035:head, will try copies on 2,3 2024-09-16T15:02:57.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.602+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620636d9:::benchmark_data_smithi116_28801_object577:head, will try copies on 3,4 2024-09-16T15:02:57.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.622+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7035b8e:::benchmark_data_smithi116_28801_object3765:head, will try copies on 2,3 2024-09-16T15:02:57.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.630+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e10399b:::benchmark_data_smithi116_28801_object2317:head, will try copies on 0,4 2024-09-16T15:02:57.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.642+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a326d53:::benchmark_data_smithi116_28801_object2113:head, will try copies on 0,4 2024-09-16T15:02:57.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.662+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b75f7837:::benchmark_data_smithi116_28801_object1773:head, will try copies on 2,3 2024-09-16T15:02:57.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.706+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a24e511:::benchmark_data_smithi116_28801_object3348:head, will try copies on 0,4 2024-09-16T15:02:57.712 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.710+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65ed8a78:::benchmark_data_smithi116_28801_object1519:head, will try copies on 3,4 2024-09-16T15:02:57.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.738+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a6e72ab:::benchmark_data_smithi116_28801_object3109:head, will try copies on 3,4 2024-09-16T15:02:57.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.742+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bcc1f1b:::benchmark_data_smithi116_28801_object2621:head, will try copies on 0,4 2024-09-16T15:02:57.779 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.774+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa17872:::benchmark_data_smithi116_28801_object1923:head, will try copies on 2,3 2024-09-16T15:02:57.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.778+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e7be8b0:::benchmark_data_smithi116_28801_object435:head, will try copies on 0,4 2024-09-16T15:02:57.802 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.798+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59df1583:::benchmark_data_smithi116_28801_object2096:head, will try copies on 3,4 2024-09-16T15:02:57.812 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.806+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20bdfda6:::benchmark_data_smithi116_28801_object955:head, will try copies on 0,4 2024-09-16T15:02:57.815 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.810+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cb80e0d:::benchmark_data_smithi116_28801_object2453:head, will try copies on 0,4 2024-09-16T15:02:57.817 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.814+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6895e9de:::benchmark_data_smithi116_28801_object1881:head, will try copies on 3,4 2024-09-16T15:02:57.844 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.838+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56bd1427:::benchmark_data_smithi116_28801_object2808:head, will try copies on 3,4 2024-09-16T15:02:57.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.842+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40861d3:::benchmark_data_smithi116_28801_object112:head, will try copies on 2,3 2024-09-16T15:02:57.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.886+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56681d2d:::benchmark_data_smithi116_28801_object2063:head, will try copies on 3,4 2024-09-16T15:02:57.897 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.894+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb90d1e:::benchmark_data_smithi116_28801_object2172:head, will try copies on 2,3 2024-09-16T15:02:57.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.898+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2366d5:::benchmark_data_smithi116_28801_object1789:head, will try copies on 0,4 2024-09-16T15:02:57.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.902+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66d112b5:::benchmark_data_smithi116_28801_object1864:head, will try copies on 3,4 2024-09-16T15:02:57.951 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.946+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b510e92:::benchmark_data_smithi116_28801_object2716:head, will try copies on 3,4 2024-09-16T15:02:57.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.950+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:941feb35:::benchmark_data_smithi116_28801_object2420:head, will try copies on 0,4 2024-09-16T15:02:57.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.970+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a9a1ae5:::benchmark_data_smithi116_28801_object1120:head, will try copies on 3,4 2024-09-16T15:02:57.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.982+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98a8099d:::benchmark_data_smithi116_28801_object1151:head, will try copies on 0,4 2024-09-16T15:02:58.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:57.998+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad83b91:::benchmark_data_smithi116_28801_object2515:head, will try copies on 0,4 2024-09-16T15:02:58.015 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.010+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bac6c5b:::benchmark_data_smithi116_28801_object2525:head, will try copies on 3,4 2024-09-16T15:02:58.026 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.022+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7356117:::benchmark_data_smithi116_28801_object2355:head, will try copies on 2,3 2024-09-16T15:02:58.036 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.034+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff5bdd9:::benchmark_data_smithi116_28801_object2976:head, will try copies on 3,4 2024-09-16T15:02:58.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.054+0000 7f541a8c9640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e202f1:::benchmark_data_smithi116_28801_object3624:head, will try copies on 3,4 2024-09-16T15:02:58.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.066+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25691fa9:::benchmark_data_smithi116_28801_object399:head, will try copies on 0,4 2024-09-16T15:02:58.086 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.082+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9976aedd:::benchmark_data_smithi116_28801_object798:head, will try copies on 0,4 2024-09-16T15:02:58.106 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.102+0000 7f541d0ce640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b9e14bf:::benchmark_data_smithi116_28801_object3516:head, will try copies on 0,4 2024-09-16T15:02:58.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.158+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29cc3ace:::benchmark_data_smithi116_28801_object3959:head, will try copies on 0,4 2024-09-16T15:02:58.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.182+0000 7f54190c6640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92830bbb:::benchmark_data_smithi116_28801_object4120:head, will try copies on 0,4 2024-09-16T15:02:58.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.190+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53225547:::benchmark_data_smithi116_28801_object3719:head, will try copies on 3,4 2024-09-16T15:02:58.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.218+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1228e91:::benchmark_data_smithi116_28801_object2416:head, will try copies on 2,3 2024-09-16T15:02:58.246 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.242+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2864dbe3:::benchmark_data_smithi116_28801_object3006:head, will try copies on 0,4 2024-09-16T15:02:58.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.266+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bac44853:::benchmark_data_smithi116_28801_object757:head, will try copies on 2,3 2024-09-16T15:02:58.277 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.274+0000 7f541b8cb640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e89e5d2:::benchmark_data_smithi116_28801_object3142:head, will try copies on 0,4 2024-09-16T15:02:58.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.274+0000 7f54168c1640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694ac6d7:::benchmark_data_smithi116_28801_object3677:head, will try copies on 3,4 2024-09-16T15:02:58.283 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.278+0000 7f541c8cd640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da6588f:::benchmark_data_smithi116_28801_object178:head, will try copies on 3,4 2024-09-16T15:02:58.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.294+0000 7f54170c2640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba12bbf7:::benchmark_data_smithi116_28801_object1304:head, will try copies on 2,3 2024-09-16T15:02:58.303 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.298+0000 7f54178c3640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2712ac41:::benchmark_data_smithi116_28801_object1825:head, will try copies on 0,4 2024-09-16T15:02:58.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.322+0000 7f54188c5640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5291c5b9:::benchmark_data_smithi116_28801_object3065:head, will try copies on 3,4 2024-09-16T15:02:58.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-16T15:02:58.342+0000 7f541b0ca640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f92059:::benchmark_data_smithi116_28801_object2579:head, will try copies on 2,3 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Total time run: 360.007 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Total reads made: 3932938 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Read size: 65536 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Object size: 1048576 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Bandwidth (MB/sec): 682.788 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Average IOPS: 10924 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Stddev IOPS: 389.974 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Max IOPS: 11665 2024-09-16T15:02:58.385 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Min IOPS: 9130 2024-09-16T15:02:58.386 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Average Latency(s): 0.00145472 2024-09-16T15:02:58.386 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Max latency(s): 0.16813 2024-09-16T15:02:58.386 INFO:tasks.radosbench.radosbench.0.smithi116.stdout:Min latency(s): 0.000210839 2024-09-16T15:03:04.381 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-09-16T15:03:04.382 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T15:03:04.382 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T15:03:04.382 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --filestore_debug_random_read_err=0.0' 2024-09-16T15:03:04.780 INFO:teuthology.orchestra.run.smithi116.stdout:{} 2024-09-16T15:03:04.780 INFO:teuthology.orchestra.run.smithi116.stderr:filestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T15:03:04.797 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0' 2024-09-16T15:03:04.942 INFO:teuthology.orchestra.run.smithi116.stdout:{} 2024-09-16T15:03:04.943 INFO:teuthology.orchestra.run.smithi116.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-16T15:03:04.959 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T15:03:04.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T15:03:04.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:03:05.614 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:05.615 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T15:03:05.630 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-16T15:03:04.626026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4329504811,"num_objects":4132,"num_object_clones":0,"num_object_copies":12394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66066,"num_write_kb":4228035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66067,"ondisk_log_size":66067,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":13243364,"kb_used_data":12685172,"kb_used_omap":9,"kb_used_meta":558134,"kb_avail":552987676,"statfs":{"total":579820584960,"available":566259380224,"internally_reserved":0,"allocated":12989616128,"data_stored":12988867940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":571529895},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[5,3,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-2,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85633,"num_read_kb":5480512,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":504,"num_bytes_recovered":528482304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":504},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003261"},"pg_stats":[{"pgid":"2.f","version":"21'4464","reported_seq":270353,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354599+0000","last_change":"2024-09-16T14:55:58.159577+0000","last_active":"2024-09-16T15:02:58.354599+0000","last_peered":"2024-09-16T15:02:58.354599+0000","last_clean":"2024-09-16T15:02:58.354599+0000","last_became_active":"2024-09-16T14:55:58.158551+0000","last_became_peered":"2024-09-16T14:55:58.158551+0000","last_unstale":"2024-09-16T15:02:58.354599+0000","last_undegraded":"2024-09-16T15:02:58.354599+0000","last_fullsized":"2024-09-16T15:02:58.354599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:50.370132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292552704,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":265865,"num_read_kb":17015360,"num_write":4464,"num_write_kb":285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"21'4271","reported_seq":258887,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.349452+0000","last_change":"2024-09-16T14:55:58.164363+0000","last_active":"2024-09-16T15:02:58.349452+0000","last_peered":"2024-09-16T15:02:58.349452+0000","last_clean":"2024-09-16T15:02:58.349452+0000","last_became_active":"2024-09-16T14:55:58.160822+0000","last_became_peered":"2024-09-16T14:55:58.160822+0000","last_unstale":"2024-09-16T15:02:58.349452+0000","last_undegraded":"2024-09-16T15:02:58.349452+0000","last_fullsized":"2024-09-16T15:02:58.349452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:43:47.719574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279904256,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":254599,"num_read_kb":16294336,"num_write":4271,"num_write_kb":273344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'4225","reported_seq":290225,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.363544+0000","last_change":"2024-09-16T15:02:58.363926+0000","last_active":"2024-09-16T15:02:58.363544+0000","last_peered":"2024-09-16T15:02:58.363544+0000","last_clean":"2024-09-16T15:02:58.363544+0000","last_became_active":"2024-09-16T14:55:57.741155+0000","last_became_peered":"2024-09-16T14:55:57.741155+0000","last_unstale":"2024-09-16T15:02:58.363544+0000","last_undegraded":"2024-09-16T15:02:58.363544+0000","last_fullsized":"2024-09-16T15:02:58.363544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4225,"log_dups_size":0,"ondisk_log_size":4225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:35:21.693051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824088,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":251676,"num_read_kb":16107201,"num_write":4225,"num_write_kb":270337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4931,"num_bytes_recovered":5170528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4931},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"21'3824","reported_seq":231633,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354290+0000","last_change":"2024-09-16T14:55:58.168716+0000","last_active":"2024-09-16T15:02:58.354290+0000","last_peered":"2024-09-16T15:02:58.354290+0000","last_clean":"2024-09-16T15:02:58.354290+0000","last_became_active":"2024-09-16T14:55:58.167901+0000","last_became_peered":"2024-09-16T14:55:58.167901+0000","last_unstale":"2024-09-16T15:02:58.354290+0000","last_undegraded":"2024-09-16T15:02:58.354290+0000","last_fullsized":"2024-09-16T15:02:58.354290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:34.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250609664,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":227792,"num_read_kb":14578688,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"21'3472","reported_seq":210293,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355178+0000","last_change":"2024-09-16T14:55:57.742732+0000","last_active":"2024-09-16T15:02:58.355178+0000","last_peered":"2024-09-16T15:02:58.355178+0000","last_clean":"2024-09-16T15:02:58.355178+0000","last_became_active":"2024-09-16T14:55:57.741678+0000","last_became_peered":"2024-09-16T14:55:57.741678+0000","last_unstale":"2024-09-16T15:02:58.355178+0000","last_undegraded":"2024-09-16T15:02:58.355178+0000","last_fullsized":"2024-09-16T15:02:58.355178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:04.173960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":206804,"num_read_kb":13235456,"num_write":3472,"num_write_kb":222208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'4016","reported_seq":276054,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.358030+0000","last_change":"2024-09-16T15:02:58.358277+0000","last_active":"2024-09-16T15:02:58.358030+0000","last_peered":"2024-09-16T15:02:58.358030+0000","last_clean":"2024-09-16T15:02:58.358030+0000","last_became_active":"2024-09-16T14:55:57.741046+0000","last_became_peered":"2024-09-16T14:55:57.741046+0000","last_unstale":"2024-09-16T15:02:58.358030+0000","last_undegraded":"2024-09-16T15:02:58.358030+0000","last_fullsized":"2024-09-16T15:02:58.358030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":238837,"num_read_kb":15285568,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4759,"num_bytes_recovered":4990173184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4759},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"21'4160","reported_seq":286044,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352027+0000","last_change":"2024-09-16T15:02:58.206062+0000","last_active":"2024-09-16T15:02:58.352027+0000","last_peered":"2024-09-16T15:02:58.352027+0000","last_clean":"2024-09-16T15:02:58.352027+0000","last_became_active":"2024-09-16T14:55:58.164678+0000","last_became_peered":"2024-09-16T14:55:58.164678+0000","last_unstale":"2024-09-16T15:02:58.352027+0000","last_undegraded":"2024-09-16T15:02:58.352027+0000","last_fullsized":"2024-09-16T15:02:58.352027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":247262,"num_read_kb":15824768,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4971,"num_bytes_recovered":5212471296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4971},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"21'3952","reported_seq":239214,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355622+0000","last_change":"2024-09-16T14:55:58.165301+0000","last_active":"2024-09-16T15:02:58.355622+0000","last_peered":"2024-09-16T15:02:58.355622+0000","last_clean":"2024-09-16T15:02:58.355622+0000","last_became_active":"2024-09-16T14:55:58.164424+0000","last_became_peered":"2024-09-16T14:55:58.164424+0000","last_unstale":"2024-09-16T15:02:58.355622+0000","last_undegraded":"2024-09-16T15:02:58.355622+0000","last_fullsized":"2024-09-16T15:02:58.355622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3952,"log_dups_size":0,"ondisk_log_size":3952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":235245,"num_read_kb":15055680,"num_write":3952,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:50.657576+0000","last_change":"2024-09-16T14:55:50.040247+0000","last_active":"2024-09-16T14:59:50.657576+0000","last_peered":"2024-09-16T14:59:50.657576+0000","last_clean":"2024-09-16T14:59:50.657576+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T14:59:50.657576+0000","last_undegraded":"2024-09-16T14:59:50.657576+0000","last_fullsized":"2024-09-16T14:59:50.657576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"21'4176","reported_seq":252870,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352334+0000","last_change":"2024-09-16T14:55:57.736198+0000","last_active":"2024-09-16T15:02:58.352334+0000","last_peered":"2024-09-16T15:02:58.352334+0000","last_clean":"2024-09-16T15:02:58.352334+0000","last_became_active":"2024-09-16T14:55:57.735457+0000","last_became_peered":"2024-09-16T14:55:57.735457+0000","last_unstale":"2024-09-16T15:02:58.352334+0000","last_undegraded":"2024-09-16T15:02:58.352334+0000","last_fullsized":"2024-09-16T15:02:58.352334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:12:18.970682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":248677,"num_read_kb":15915328,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:59.622709+0000","last_change":"2024-09-16T14:55:50.089023+0000","last_active":"2024-09-16T14:59:59.622709+0000","last_peered":"2024-09-16T14:59:59.622709+0000","last_clean":"2024-09-16T14:59:59.622709+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T14:59:59.622709+0000","last_undegraded":"2024-09-16T14:59:59.622709+0000","last_fullsized":"2024-09-16T14:59:59.622709+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'4016","reported_seq":243216,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352482+0000","last_change":"2024-09-16T14:55:58.161956+0000","last_active":"2024-09-16T15:02:58.352482+0000","last_peered":"2024-09-16T15:02:58.352482+0000","last_clean":"2024-09-16T15:02:58.352482+0000","last_became_active":"2024-09-16T14:55:58.160928+0000","last_became_peered":"2024-09-16T14:55:58.160928+0000","last_unstale":"2024-09-16T15:02:58.352482+0000","last_undegraded":"2024-09-16T15:02:58.352482+0000","last_fullsized":"2024-09-16T15:02:58.352482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:17:01.484904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":239183,"num_read_kb":15307712,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"16'2","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615368+0000","last_change":"2024-09-16T14:55:49.604671+0000","last_active":"2024-09-16T15:00:00.615368+0000","last_peered":"2024-09-16T15:00:00.615368+0000","last_clean":"2024-09-16T15:00:00.615368+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T15:00:00.615368+0000","last_undegraded":"2024-09-16T15:00:00.615368+0000","last_fullsized":"2024-09-16T15:00:00.615368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"21'4144","reported_seq":250709,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.343842+0000","last_change":"2024-09-16T14:55:58.161979+0000","last_active":"2024-09-16T15:02:58.343842+0000","last_peered":"2024-09-16T15:02:58.343842+0000","last_clean":"2024-09-16T15:02:58.343842+0000","last_became_active":"2024-09-16T14:55:58.160444+0000","last_became_peered":"2024-09-16T14:55:58.160444+0000","last_unstale":"2024-09-16T15:02:58.343842+0000","last_undegraded":"2024-09-16T15:02:58.343842+0000","last_fullsized":"2024-09-16T15:02:58.343842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:34.138944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":246548,"num_read_kb":15779072,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"14'1","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.764934+0000","last_change":"2024-09-16T14:55:49.601026+0000","last_active":"2024-09-16T15:00:00.764934+0000","last_peered":"2024-09-16T15:00:00.764934+0000","last_clean":"2024-09-16T15:00:00.764934+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T15:00:00.764934+0000","last_undegraded":"2024-09-16T15:00:00.764934+0000","last_fullsized":"2024-09-16T15:00:00.764934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"21'4160","reported_seq":252366,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356538+0000","last_change":"2024-09-16T14:55:58.164906+0000","last_active":"2024-09-16T15:02:58.356538+0000","last_peered":"2024-09-16T15:02:58.356538+0000","last_clean":"2024-09-16T15:02:58.356538+0000","last_became_active":"2024-09-16T14:55:58.164104+0000","last_became_peered":"2024-09-16T14:55:58.164104+0000","last_unstale":"2024-09-16T15:02:58.356538+0000","last_undegraded":"2024-09-16T15:02:58.356538+0000","last_fullsized":"2024-09-16T15:02:58.356538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":248189,"num_read_kb":15884096,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4432","reported_seq":268128,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354016+0000","last_change":"2024-09-16T14:55:57.741019+0000","last_active":"2024-09-16T15:02:58.354016+0000","last_peered":"2024-09-16T15:02:58.354016+0000","last_clean":"2024-09-16T15:02:58.354016+0000","last_became_active":"2024-09-16T14:55:57.740121+0000","last_became_peered":"2024-09-16T14:55:57.740121+0000","last_unstale":"2024-09-16T15:02:58.354016+0000","last_undegraded":"2024-09-16T15:02:58.354016+0000","last_fullsized":"2024-09-16T15:02:58.354016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:55.266300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":263679,"num_read_kb":16875456,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.768498+0000","last_change":"2024-09-16T14:55:49.600852+0000","last_active":"2024-09-16T15:00:00.768498+0000","last_peered":"2024-09-16T15:00:00.768498+0000","last_clean":"2024-09-16T15:00:00.768498+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T15:00:00.768498+0000","last_undegraded":"2024-09-16T15:00:00.768498+0000","last_fullsized":"2024-09-16T15:00:00.768498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'4240","reported_seq":291412,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356282+0000","last_change":"2024-09-16T15:02:58.315413+0000","last_active":"2024-09-16T15:02:58.356282+0000","last_peered":"2024-09-16T15:02:58.356282+0000","last_clean":"2024-09-16T15:02:58.356282+0000","last_became_active":"2024-09-16T14:55:57.737731+0000","last_became_peered":"2024-09-16T14:55:57.737731+0000","last_unstale":"2024-09-16T15:02:58.356282+0000","last_undegraded":"2024-09-16T15:02:58.356282+0000","last_fullsized":"2024-09-16T15:02:58.356282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:33:09.843078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":252293,"num_read_kb":16146752,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5005,"num_bytes_recovered":5248122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5005},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615388+0000","last_change":"2024-09-16T14:55:49.603629+0000","last_active":"2024-09-16T15:00:00.615388+0000","last_peered":"2024-09-16T15:00:00.615388+0000","last_clean":"2024-09-16T15:00:00.615388+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T15:00:00.615388+0000","last_undegraded":"2024-09-16T15:00:00.615388+0000","last_fullsized":"2024-09-16T15:00:00.615388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"21'4256","reported_seq":257533,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355605+0000","last_change":"2024-09-16T14:55:58.161552+0000","last_active":"2024-09-16T15:02:58.355605+0000","last_peered":"2024-09-16T15:02:58.355605+0000","last_clean":"2024-09-16T15:02:58.355605+0000","last_became_active":"2024-09-16T14:55:58.160681+0000","last_became_peered":"2024-09-16T14:55:58.160681+0000","last_unstale":"2024-09-16T15:02:58.355605+0000","last_undegraded":"2024-09-16T15:02:58.355605+0000","last_fullsized":"2024-09-16T15:02:58.355605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253260,"num_read_kb":16208640,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:10.665440+0000","last_change":"2024-09-16T14:55:50.040167+0000","last_active":"2024-09-16T15:00:10.665440+0000","last_peered":"2024-09-16T15:00:10.665440+0000","last_clean":"2024-09-16T15:00:10.665440+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T15:00:10.665440+0000","last_undegraded":"2024-09-16T15:00:10.665440+0000","last_fullsized":"2024-09-16T15:00:10.665440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:09.624095+0000","last_change":"2024-09-16T14:55:50.089122+0000","last_active":"2024-09-16T15:00:09.624095+0000","last_peered":"2024-09-16T15:00:09.624095+0000","last_clean":"2024-09-16T15:00:09.624095+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T15:00:09.624095+0000","last_undegraded":"2024-09-16T15:00:09.624095+0000","last_fullsized":"2024-09-16T15:00:09.624095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"21'4256","reported_seq":291790,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354087+0000","last_change":"2024-09-16T15:02:58.350569+0000","last_active":"2024-09-16T15:02:58.354087+0000","last_peered":"2024-09-16T15:02:58.354087+0000","last_clean":"2024-09-16T15:02:58.354087+0000","last_became_active":"2024-09-16T14:55:58.164766+0000","last_became_peered":"2024-09-16T14:55:58.164766+0000","last_unstale":"2024-09-16T15:02:58.354087+0000","last_undegraded":"2024-09-16T15:02:58.354087+0000","last_fullsized":"2024-09-16T15:02:58.354087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253030,"num_read_kb":16193920,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4949,"num_bytes_recovered":5189402624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4949},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4329504792,"num_objects":4130,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66064,"num_write_kb":4228033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12988526592,"data_stored":12988514376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66064,"ondisk_log_size":66064,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640345,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2198332,"kb_used_data":2131124,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92173508,"statfs":{"total":96636764160,"available":94385672192,"internally_reserved":0,"allocated":2182270976,"data_stored":2182145596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.44400000000000001},"min":{"1min":0.23000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.498,"5min":0.70199999999999996,"15min":1.6399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.48999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.75900000000000001,"15min":1.4039999999999999},"last":0.376}]},{"osd":1,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.73299999999999998,"5min":0.97599999999999998,"15min":1.079},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.44500000000000001},"min":{"1min":0.24099999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.45900000000000002,"5min":1.0529999999999999,"15min":1.1819999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.52700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.58399999999999996,"5min":1.681,"15min":1.681},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66200000000000003,"5min":0.94499999999999995,"15min":1.1020000000000001},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.76200000000000001,"15min":1.274},"last":0.255},{"interface":"front","average":{"1min":0.378,"5min":0.375,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56299999999999994,"5min":0.90000000000000002,"15min":1.5249999999999999},"last":0.318}]},{"osd":5,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.378,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":1.0109999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.504},"min":{"1min":0.27000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55000000000000004,"5min":0.74199999999999999,"15min":1.347},"last":0.48799999999999999}]}]},{"osd":3,"up_from":11,"seq":47244640346,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2685692,"kb_used_data":2614388,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":91686148,"statfs":{"total":96636764160,"available":93886615552,"internally_reserved":0,"allocated":2677133312,"data_stored":2677007937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.45800000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":2.1309999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.47999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":0.88100000000000001,"5min":1.377,"15min":1.377},"last":0.88100000000000001}]},{"osd":1,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40699999999999997,"15min":0.53900000000000003},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.85099999999999998,"5min":1.587,"15min":1.8540000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38800000000000001,"15min":0.52700000000000002},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.80200000000000005,"5min":1.1919999999999999,"15min":2.504},"last":0.80200000000000005}]},{"osd":2,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":1.8080000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":2.3679999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.46000000000000002},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.71899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.51000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":1.883},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.60599999999999998},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.68000000000000005,"5min":0.996,"15min":3.968},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.82899999999999996,"5min":1.359,"15min":1.359},"last":0.82899999999999996}]}]},{"osd":2,"up_from":11,"seq":47244640345,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1662076,"kb_used_data":1604724,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":92709764,"statfs":{"total":96636764160,"available":94934798336,"internally_reserved":0,"allocated":1643237376,"data_stored":1643112001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26200000000000001,"15min":0.33500000000000002},"min":{"1min":0.17799999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42299999999999999,"5min":0.79400000000000004,"15min":1.222},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36699999999999999,"15min":0.42799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.64700000000000002,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.86799999999999999,"15min":0.57199999999999995},"min":{"1min":0.19500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71099999999999997,"5min":53.473999999999997,"15min":53.473999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.81100000000000005,"15min":0.58799999999999997},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":0.51800000000000002,"5min":53.326000000000001,"15min":53.326000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.47599999999999998},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1950000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.26200000000000001},"max":{"1min":0.72999999999999998,"5min":1.839,"15min":1.839},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":1.8380000000000001},"last":0.877},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61899999999999999,"5min":0.65900000000000003,"15min":0.92900000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.016,"15min":0.70899999999999996},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":58.322000000000003,"15min":58.322000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.91900000000000004,"15min":0.70999999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":58.619,"15min":58.619},"last":0.94099999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640345,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2613052,"kb_used_data":2393268,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":91758788,"statfs":{"total":96636764160,"available":93960998912,"internally_reserved":0,"allocated":2450706432,"data_stored":2450581057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[2,1,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.253,"15min":0.29599999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.41099999999999998,"5min":0.60199999999999998,"15min":0.72499999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.307,"15min":0.33500000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16400000000000001},"max":{"1min":0.54800000000000004,"5min":0.61099999999999999,"15min":0.77500000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.26200000000000001,"15min":0.34100000000000003},"min":{"1min":0.182,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.51900000000000002,"5min":0.64900000000000002,"15min":0.73299999999999998},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.33000000000000002,"15min":0.375},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.60299999999999998,"15min":0.88400000000000001},"last":0.312}]},{"osd":3,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.748,"15min":0.60899999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61299999999999999,"5min":30.193000000000001,"15min":30.193000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.69999999999999996,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":30.173999999999999,"15min":30.173999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38300000000000001,"15min":0.45600000000000002},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.68500000000000005,"15min":1.0860000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45500000000000002,"15min":0.51700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57199999999999995,"5min":0.89800000000000002,"15min":1.325},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40600000000000003,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.59199999999999997,"5min":0.98299999999999998,"15min":1.036},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.438,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.48699999999999999,"5min":0.97199999999999998,"15min":1.2829999999999999},"last":0.432}]}]},{"osd":5,"up_from":11,"seq":47244640345,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1334456,"kb_used_data":1285296,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":93037384,"statfs":{"total":96636764160,"available":95270281216,"internally_reserved":0,"allocated":1316143104,"data_stored":1316021801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50330055},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.46899999999999997},"min":{"1min":0.22900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.536},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":1.343,"15min":0.80300000000000005},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":2.3149999999999999,"5min":79.933999999999997,"15min":79.933999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":1.325,"15min":0.78500000000000003},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.90600000000000003,"5min":79.793999999999997,"15min":79.793999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.54500000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":1.6180000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.41799999999999998,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.5940000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.376,"15min":0.53200000000000003},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.359},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.38,"15min":0.498},"min":{"1min":0.25700000000000001,"5min":0.216,"15min":0.216},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.458},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.434,"15min":0.51400000000000001},"min":{"1min":0.30399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.35499999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2749756,"kb_used_data":2656372,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":91622084,"statfs":{"total":96636764160,"available":93821014016,"internally_reserved":0,"allocated":2720124928,"data_stored":2719999548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.26600000000000001,"15min":0.39500000000000002},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.45400000000000001,"5min":1.026,"15min":2.4620000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.30399999999999999,"15min":0.437},"min":{"1min":0.216,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":1.0369999999999999,"15min":2.5030000000000001},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.27800000000000002,"15min":0.36699999999999999},"min":{"1min":0.20200000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.318,"5min":0.34799999999999998,"15min":0.38400000000000001},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.71399999999999997,"15min":0.60599999999999998},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":33.82,"15min":33.82},"last":0.999},{"interface":"front","average":{"1min":0.374,"5min":0.69599999999999995,"15min":0.58299999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79100000000000004,"5min":32.356000000000002,"15min":32.356000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57499999999999996,"5min":0.92500000000000004,"15min":2.8780000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.86499999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39300000000000002,"15min":5.8540000000000001},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.47399999999999998,"5min":0.63,"15min":143.86699999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.442,"15min":0.56499999999999995},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56200000000000006,"5min":0.98299999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2719940608,"data_stored":2719940608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2450526208,"data_stored":2450522136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643057152,"data_stored":1643053080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2676953088,"data_stored":2676949016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2182086656,"data_stored":2182086656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1315962880,"data_stored":1315962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:03:05.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:03:05.924 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:05.925 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T15:03:05.940 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-16T15:03:04.626026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4329504811,"num_objects":4132,"num_object_clones":0,"num_object_copies":12394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66066,"num_write_kb":4228035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66067,"ondisk_log_size":66067,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":13243364,"kb_used_data":12685172,"kb_used_omap":9,"kb_used_meta":558134,"kb_avail":552987676,"statfs":{"total":579820584960,"available":566259380224,"internally_reserved":0,"allocated":12989616128,"data_stored":12988867940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":571529895},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[5,3,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-2,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85633,"num_read_kb":5480512,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":504,"num_bytes_recovered":528482304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":504},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003261"},"pg_stats":[{"pgid":"2.f","version":"21'4464","reported_seq":270353,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354599+0000","last_change":"2024-09-16T14:55:58.159577+0000","last_active":"2024-09-16T15:02:58.354599+0000","last_peered":"2024-09-16T15:02:58.354599+0000","last_clean":"2024-09-16T15:02:58.354599+0000","last_became_active":"2024-09-16T14:55:58.158551+0000","last_became_peered":"2024-09-16T14:55:58.158551+0000","last_unstale":"2024-09-16T15:02:58.354599+0000","last_undegraded":"2024-09-16T15:02:58.354599+0000","last_fullsized":"2024-09-16T15:02:58.354599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:50.370132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292552704,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":265865,"num_read_kb":17015360,"num_write":4464,"num_write_kb":285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"21'4271","reported_seq":258887,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.349452+0000","last_change":"2024-09-16T14:55:58.164363+0000","last_active":"2024-09-16T15:02:58.349452+0000","last_peered":"2024-09-16T15:02:58.349452+0000","last_clean":"2024-09-16T15:02:58.349452+0000","last_became_active":"2024-09-16T14:55:58.160822+0000","last_became_peered":"2024-09-16T14:55:58.160822+0000","last_unstale":"2024-09-16T15:02:58.349452+0000","last_undegraded":"2024-09-16T15:02:58.349452+0000","last_fullsized":"2024-09-16T15:02:58.349452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:43:47.719574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279904256,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":254599,"num_read_kb":16294336,"num_write":4271,"num_write_kb":273344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'4225","reported_seq":290225,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.363544+0000","last_change":"2024-09-16T15:02:58.363926+0000","last_active":"2024-09-16T15:02:58.363544+0000","last_peered":"2024-09-16T15:02:58.363544+0000","last_clean":"2024-09-16T15:02:58.363544+0000","last_became_active":"2024-09-16T14:55:57.741155+0000","last_became_peered":"2024-09-16T14:55:57.741155+0000","last_unstale":"2024-09-16T15:02:58.363544+0000","last_undegraded":"2024-09-16T15:02:58.363544+0000","last_fullsized":"2024-09-16T15:02:58.363544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4225,"log_dups_size":0,"ondisk_log_size":4225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:35:21.693051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824088,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":251676,"num_read_kb":16107201,"num_write":4225,"num_write_kb":270337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4931,"num_bytes_recovered":5170528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4931},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"21'3824","reported_seq":231633,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354290+0000","last_change":"2024-09-16T14:55:58.168716+0000","last_active":"2024-09-16T15:02:58.354290+0000","last_peered":"2024-09-16T15:02:58.354290+0000","last_clean":"2024-09-16T15:02:58.354290+0000","last_became_active":"2024-09-16T14:55:58.167901+0000","last_became_peered":"2024-09-16T14:55:58.167901+0000","last_unstale":"2024-09-16T15:02:58.354290+0000","last_undegraded":"2024-09-16T15:02:58.354290+0000","last_fullsized":"2024-09-16T15:02:58.354290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:34.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250609664,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":227792,"num_read_kb":14578688,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"21'3472","reported_seq":210293,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355178+0000","last_change":"2024-09-16T14:55:57.742732+0000","last_active":"2024-09-16T15:02:58.355178+0000","last_peered":"2024-09-16T15:02:58.355178+0000","last_clean":"2024-09-16T15:02:58.355178+0000","last_became_active":"2024-09-16T14:55:57.741678+0000","last_became_peered":"2024-09-16T14:55:57.741678+0000","last_unstale":"2024-09-16T15:02:58.355178+0000","last_undegraded":"2024-09-16T15:02:58.355178+0000","last_fullsized":"2024-09-16T15:02:58.355178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:04.173960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":206804,"num_read_kb":13235456,"num_write":3472,"num_write_kb":222208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'4016","reported_seq":276054,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.358030+0000","last_change":"2024-09-16T15:02:58.358277+0000","last_active":"2024-09-16T15:02:58.358030+0000","last_peered":"2024-09-16T15:02:58.358030+0000","last_clean":"2024-09-16T15:02:58.358030+0000","last_became_active":"2024-09-16T14:55:57.741046+0000","last_became_peered":"2024-09-16T14:55:57.741046+0000","last_unstale":"2024-09-16T15:02:58.358030+0000","last_undegraded":"2024-09-16T15:02:58.358030+0000","last_fullsized":"2024-09-16T15:02:58.358030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":238837,"num_read_kb":15285568,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4759,"num_bytes_recovered":4990173184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4759},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"21'4160","reported_seq":286044,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352027+0000","last_change":"2024-09-16T15:02:58.206062+0000","last_active":"2024-09-16T15:02:58.352027+0000","last_peered":"2024-09-16T15:02:58.352027+0000","last_clean":"2024-09-16T15:02:58.352027+0000","last_became_active":"2024-09-16T14:55:58.164678+0000","last_became_peered":"2024-09-16T14:55:58.164678+0000","last_unstale":"2024-09-16T15:02:58.352027+0000","last_undegraded":"2024-09-16T15:02:58.352027+0000","last_fullsized":"2024-09-16T15:02:58.352027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":247262,"num_read_kb":15824768,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4971,"num_bytes_recovered":5212471296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4971},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"21'3952","reported_seq":239214,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355622+0000","last_change":"2024-09-16T14:55:58.165301+0000","last_active":"2024-09-16T15:02:58.355622+0000","last_peered":"2024-09-16T15:02:58.355622+0000","last_clean":"2024-09-16T15:02:58.355622+0000","last_became_active":"2024-09-16T14:55:58.164424+0000","last_became_peered":"2024-09-16T14:55:58.164424+0000","last_unstale":"2024-09-16T15:02:58.355622+0000","last_undegraded":"2024-09-16T15:02:58.355622+0000","last_fullsized":"2024-09-16T15:02:58.355622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3952,"log_dups_size":0,"ondisk_log_size":3952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":235245,"num_read_kb":15055680,"num_write":3952,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:50.657576+0000","last_change":"2024-09-16T14:55:50.040247+0000","last_active":"2024-09-16T14:59:50.657576+0000","last_peered":"2024-09-16T14:59:50.657576+0000","last_clean":"2024-09-16T14:59:50.657576+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T14:59:50.657576+0000","last_undegraded":"2024-09-16T14:59:50.657576+0000","last_fullsized":"2024-09-16T14:59:50.657576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"21'4176","reported_seq":252870,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352334+0000","last_change":"2024-09-16T14:55:57.736198+0000","last_active":"2024-09-16T15:02:58.352334+0000","last_peered":"2024-09-16T15:02:58.352334+0000","last_clean":"2024-09-16T15:02:58.352334+0000","last_became_active":"2024-09-16T14:55:57.735457+0000","last_became_peered":"2024-09-16T14:55:57.735457+0000","last_unstale":"2024-09-16T15:02:58.352334+0000","last_undegraded":"2024-09-16T15:02:58.352334+0000","last_fullsized":"2024-09-16T15:02:58.352334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:12:18.970682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":248677,"num_read_kb":15915328,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:59.622709+0000","last_change":"2024-09-16T14:55:50.089023+0000","last_active":"2024-09-16T14:59:59.622709+0000","last_peered":"2024-09-16T14:59:59.622709+0000","last_clean":"2024-09-16T14:59:59.622709+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T14:59:59.622709+0000","last_undegraded":"2024-09-16T14:59:59.622709+0000","last_fullsized":"2024-09-16T14:59:59.622709+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'4016","reported_seq":243216,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352482+0000","last_change":"2024-09-16T14:55:58.161956+0000","last_active":"2024-09-16T15:02:58.352482+0000","last_peered":"2024-09-16T15:02:58.352482+0000","last_clean":"2024-09-16T15:02:58.352482+0000","last_became_active":"2024-09-16T14:55:58.160928+0000","last_became_peered":"2024-09-16T14:55:58.160928+0000","last_unstale":"2024-09-16T15:02:58.352482+0000","last_undegraded":"2024-09-16T15:02:58.352482+0000","last_fullsized":"2024-09-16T15:02:58.352482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:17:01.484904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":239183,"num_read_kb":15307712,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"16'2","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615368+0000","last_change":"2024-09-16T14:55:49.604671+0000","last_active":"2024-09-16T15:00:00.615368+0000","last_peered":"2024-09-16T15:00:00.615368+0000","last_clean":"2024-09-16T15:00:00.615368+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T15:00:00.615368+0000","last_undegraded":"2024-09-16T15:00:00.615368+0000","last_fullsized":"2024-09-16T15:00:00.615368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"21'4144","reported_seq":250709,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.343842+0000","last_change":"2024-09-16T14:55:58.161979+0000","last_active":"2024-09-16T15:02:58.343842+0000","last_peered":"2024-09-16T15:02:58.343842+0000","last_clean":"2024-09-16T15:02:58.343842+0000","last_became_active":"2024-09-16T14:55:58.160444+0000","last_became_peered":"2024-09-16T14:55:58.160444+0000","last_unstale":"2024-09-16T15:02:58.343842+0000","last_undegraded":"2024-09-16T15:02:58.343842+0000","last_fullsized":"2024-09-16T15:02:58.343842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:34.138944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":246548,"num_read_kb":15779072,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"14'1","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.764934+0000","last_change":"2024-09-16T14:55:49.601026+0000","last_active":"2024-09-16T15:00:00.764934+0000","last_peered":"2024-09-16T15:00:00.764934+0000","last_clean":"2024-09-16T15:00:00.764934+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T15:00:00.764934+0000","last_undegraded":"2024-09-16T15:00:00.764934+0000","last_fullsized":"2024-09-16T15:00:00.764934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"21'4160","reported_seq":252366,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356538+0000","last_change":"2024-09-16T14:55:58.164906+0000","last_active":"2024-09-16T15:02:58.356538+0000","last_peered":"2024-09-16T15:02:58.356538+0000","last_clean":"2024-09-16T15:02:58.356538+0000","last_became_active":"2024-09-16T14:55:58.164104+0000","last_became_peered":"2024-09-16T14:55:58.164104+0000","last_unstale":"2024-09-16T15:02:58.356538+0000","last_undegraded":"2024-09-16T15:02:58.356538+0000","last_fullsized":"2024-09-16T15:02:58.356538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":248189,"num_read_kb":15884096,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4432","reported_seq":268128,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354016+0000","last_change":"2024-09-16T14:55:57.741019+0000","last_active":"2024-09-16T15:02:58.354016+0000","last_peered":"2024-09-16T15:02:58.354016+0000","last_clean":"2024-09-16T15:02:58.354016+0000","last_became_active":"2024-09-16T14:55:57.740121+0000","last_became_peered":"2024-09-16T14:55:57.740121+0000","last_unstale":"2024-09-16T15:02:58.354016+0000","last_undegraded":"2024-09-16T15:02:58.354016+0000","last_fullsized":"2024-09-16T15:02:58.354016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:55.266300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":263679,"num_read_kb":16875456,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.768498+0000","last_change":"2024-09-16T14:55:49.600852+0000","last_active":"2024-09-16T15:00:00.768498+0000","last_peered":"2024-09-16T15:00:00.768498+0000","last_clean":"2024-09-16T15:00:00.768498+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T15:00:00.768498+0000","last_undegraded":"2024-09-16T15:00:00.768498+0000","last_fullsized":"2024-09-16T15:00:00.768498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'4240","reported_seq":291412,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356282+0000","last_change":"2024-09-16T15:02:58.315413+0000","last_active":"2024-09-16T15:02:58.356282+0000","last_peered":"2024-09-16T15:02:58.356282+0000","last_clean":"2024-09-16T15:02:58.356282+0000","last_became_active":"2024-09-16T14:55:57.737731+0000","last_became_peered":"2024-09-16T14:55:57.737731+0000","last_unstale":"2024-09-16T15:02:58.356282+0000","last_undegraded":"2024-09-16T15:02:58.356282+0000","last_fullsized":"2024-09-16T15:02:58.356282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:33:09.843078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":252293,"num_read_kb":16146752,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5005,"num_bytes_recovered":5248122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5005},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615388+0000","last_change":"2024-09-16T14:55:49.603629+0000","last_active":"2024-09-16T15:00:00.615388+0000","last_peered":"2024-09-16T15:00:00.615388+0000","last_clean":"2024-09-16T15:00:00.615388+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T15:00:00.615388+0000","last_undegraded":"2024-09-16T15:00:00.615388+0000","last_fullsized":"2024-09-16T15:00:00.615388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"21'4256","reported_seq":257533,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355605+0000","last_change":"2024-09-16T14:55:58.161552+0000","last_active":"2024-09-16T15:02:58.355605+0000","last_peered":"2024-09-16T15:02:58.355605+0000","last_clean":"2024-09-16T15:02:58.355605+0000","last_became_active":"2024-09-16T14:55:58.160681+0000","last_became_peered":"2024-09-16T14:55:58.160681+0000","last_unstale":"2024-09-16T15:02:58.355605+0000","last_undegraded":"2024-09-16T15:02:58.355605+0000","last_fullsized":"2024-09-16T15:02:58.355605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253260,"num_read_kb":16208640,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:10.665440+0000","last_change":"2024-09-16T14:55:50.040167+0000","last_active":"2024-09-16T15:00:10.665440+0000","last_peered":"2024-09-16T15:00:10.665440+0000","last_clean":"2024-09-16T15:00:10.665440+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T15:00:10.665440+0000","last_undegraded":"2024-09-16T15:00:10.665440+0000","last_fullsized":"2024-09-16T15:00:10.665440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:09.624095+0000","last_change":"2024-09-16T14:55:50.089122+0000","last_active":"2024-09-16T15:00:09.624095+0000","last_peered":"2024-09-16T15:00:09.624095+0000","last_clean":"2024-09-16T15:00:09.624095+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T15:00:09.624095+0000","last_undegraded":"2024-09-16T15:00:09.624095+0000","last_fullsized":"2024-09-16T15:00:09.624095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"21'4256","reported_seq":291790,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354087+0000","last_change":"2024-09-16T15:02:58.350569+0000","last_active":"2024-09-16T15:02:58.354087+0000","last_peered":"2024-09-16T15:02:58.354087+0000","last_clean":"2024-09-16T15:02:58.354087+0000","last_became_active":"2024-09-16T14:55:58.164766+0000","last_became_peered":"2024-09-16T14:55:58.164766+0000","last_unstale":"2024-09-16T15:02:58.354087+0000","last_undegraded":"2024-09-16T15:02:58.354087+0000","last_fullsized":"2024-09-16T15:02:58.354087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253030,"num_read_kb":16193920,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4949,"num_bytes_recovered":5189402624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4949},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4329504792,"num_objects":4130,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66064,"num_write_kb":4228033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12988526592,"data_stored":12988514376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66064,"ondisk_log_size":66064,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640345,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2198332,"kb_used_data":2131124,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92173508,"statfs":{"total":96636764160,"available":94385672192,"internally_reserved":0,"allocated":2182270976,"data_stored":2182145596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.44400000000000001},"min":{"1min":0.23000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.498,"5min":0.70199999999999996,"15min":1.6399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.48999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.75900000000000001,"15min":1.4039999999999999},"last":0.376}]},{"osd":1,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.73299999999999998,"5min":0.97599999999999998,"15min":1.079},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.44500000000000001},"min":{"1min":0.24099999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.45900000000000002,"5min":1.0529999999999999,"15min":1.1819999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.52700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.58399999999999996,"5min":1.681,"15min":1.681},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66200000000000003,"5min":0.94499999999999995,"15min":1.1020000000000001},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.76200000000000001,"15min":1.274},"last":0.255},{"interface":"front","average":{"1min":0.378,"5min":0.375,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56299999999999994,"5min":0.90000000000000002,"15min":1.5249999999999999},"last":0.318}]},{"osd":5,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.378,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":1.0109999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.504},"min":{"1min":0.27000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55000000000000004,"5min":0.74199999999999999,"15min":1.347},"last":0.48799999999999999}]}]},{"osd":3,"up_from":11,"seq":47244640346,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2685692,"kb_used_data":2614388,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":91686148,"statfs":{"total":96636764160,"available":93886615552,"internally_reserved":0,"allocated":2677133312,"data_stored":2677007937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.45800000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":2.1309999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.47999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":0.88100000000000001,"5min":1.377,"15min":1.377},"last":0.88100000000000001}]},{"osd":1,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40699999999999997,"15min":0.53900000000000003},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.85099999999999998,"5min":1.587,"15min":1.8540000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38800000000000001,"15min":0.52700000000000002},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.80200000000000005,"5min":1.1919999999999999,"15min":2.504},"last":0.80200000000000005}]},{"osd":2,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":1.8080000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":2.3679999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.46000000000000002},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.71899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.51000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":1.883},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.60599999999999998},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.68000000000000005,"5min":0.996,"15min":3.968},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.82899999999999996,"5min":1.359,"15min":1.359},"last":0.82899999999999996}]}]},{"osd":2,"up_from":11,"seq":47244640345,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1662076,"kb_used_data":1604724,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":92709764,"statfs":{"total":96636764160,"available":94934798336,"internally_reserved":0,"allocated":1643237376,"data_stored":1643112001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26200000000000001,"15min":0.33500000000000002},"min":{"1min":0.17799999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42299999999999999,"5min":0.79400000000000004,"15min":1.222},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36699999999999999,"15min":0.42799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.64700000000000002,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.86799999999999999,"15min":0.57199999999999995},"min":{"1min":0.19500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71099999999999997,"5min":53.473999999999997,"15min":53.473999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.81100000000000005,"15min":0.58799999999999997},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":0.51800000000000002,"5min":53.326000000000001,"15min":53.326000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.47599999999999998},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1950000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.26200000000000001},"max":{"1min":0.72999999999999998,"5min":1.839,"15min":1.839},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":1.8380000000000001},"last":0.877},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61899999999999999,"5min":0.65900000000000003,"15min":0.92900000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.016,"15min":0.70899999999999996},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":58.322000000000003,"15min":58.322000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.91900000000000004,"15min":0.70999999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":58.619,"15min":58.619},"last":0.94099999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640345,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2613052,"kb_used_data":2393268,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":91758788,"statfs":{"total":96636764160,"available":93960998912,"internally_reserved":0,"allocated":2450706432,"data_stored":2450581057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[2,1,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.253,"15min":0.29599999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.41099999999999998,"5min":0.60199999999999998,"15min":0.72499999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.307,"15min":0.33500000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16400000000000001},"max":{"1min":0.54800000000000004,"5min":0.61099999999999999,"15min":0.77500000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.26200000000000001,"15min":0.34100000000000003},"min":{"1min":0.182,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.51900000000000002,"5min":0.64900000000000002,"15min":0.73299999999999998},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.33000000000000002,"15min":0.375},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.60299999999999998,"15min":0.88400000000000001},"last":0.312}]},{"osd":3,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.748,"15min":0.60899999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61299999999999999,"5min":30.193000000000001,"15min":30.193000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.69999999999999996,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":30.173999999999999,"15min":30.173999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38300000000000001,"15min":0.45600000000000002},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.68500000000000005,"15min":1.0860000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45500000000000002,"15min":0.51700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57199999999999995,"5min":0.89800000000000002,"15min":1.325},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40600000000000003,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.59199999999999997,"5min":0.98299999999999998,"15min":1.036},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.438,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.48699999999999999,"5min":0.97199999999999998,"15min":1.2829999999999999},"last":0.432}]}]},{"osd":5,"up_from":11,"seq":47244640345,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1334456,"kb_used_data":1285296,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":93037384,"statfs":{"total":96636764160,"available":95270281216,"internally_reserved":0,"allocated":1316143104,"data_stored":1316021801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50330055},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.46899999999999997},"min":{"1min":0.22900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.536},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":1.343,"15min":0.80300000000000005},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":2.3149999999999999,"5min":79.933999999999997,"15min":79.933999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":1.325,"15min":0.78500000000000003},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.90600000000000003,"5min":79.793999999999997,"15min":79.793999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.54500000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":1.6180000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.41799999999999998,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.5940000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.376,"15min":0.53200000000000003},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.359},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.38,"15min":0.498},"min":{"1min":0.25700000000000001,"5min":0.216,"15min":0.216},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.458},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.434,"15min":0.51400000000000001},"min":{"1min":0.30399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.35499999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2749756,"kb_used_data":2656372,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":91622084,"statfs":{"total":96636764160,"available":93821014016,"internally_reserved":0,"allocated":2720124928,"data_stored":2719999548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.26600000000000001,"15min":0.39500000000000002},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.45400000000000001,"5min":1.026,"15min":2.4620000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.30399999999999999,"15min":0.437},"min":{"1min":0.216,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":1.0369999999999999,"15min":2.5030000000000001},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.27800000000000002,"15min":0.36699999999999999},"min":{"1min":0.20200000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.318,"5min":0.34799999999999998,"15min":0.38400000000000001},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.71399999999999997,"15min":0.60599999999999998},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":33.82,"15min":33.82},"last":0.999},{"interface":"front","average":{"1min":0.374,"5min":0.69599999999999995,"15min":0.58299999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79100000000000004,"5min":32.356000000000002,"15min":32.356000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57499999999999996,"5min":0.92500000000000004,"15min":2.8780000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.86499999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39300000000000002,"15min":5.8540000000000001},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.47399999999999998,"5min":0.63,"15min":143.86699999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.442,"15min":0.56499999999999995},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56200000000000006,"5min":0.98299999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2719940608,"data_stored":2719940608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2450526208,"data_stored":2450522136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643057152,"data_stored":1643053080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2676953088,"data_stored":2676949016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2182086656,"data_stored":2182086656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1315962880,"data_stored":1315962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:03:05.942 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T15:03:05.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:03:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:06.229 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T15:03:06.244 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-16T15:03:04.626026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4329504811,"num_objects":4132,"num_object_clones":0,"num_object_copies":12394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66066,"num_write_kb":4228035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66067,"ondisk_log_size":66067,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":13243364,"kb_used_data":12685172,"kb_used_omap":9,"kb_used_meta":558134,"kb_avail":552987676,"statfs":{"total":579820584960,"available":566259380224,"internally_reserved":0,"allocated":12989616128,"data_stored":12988867940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":571529895},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[5,3,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-2,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85633,"num_read_kb":5480512,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":504,"num_bytes_recovered":528482304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":504},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003261"},"pg_stats":[{"pgid":"2.f","version":"21'4464","reported_seq":270353,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354599+0000","last_change":"2024-09-16T14:55:58.159577+0000","last_active":"2024-09-16T15:02:58.354599+0000","last_peered":"2024-09-16T15:02:58.354599+0000","last_clean":"2024-09-16T15:02:58.354599+0000","last_became_active":"2024-09-16T14:55:58.158551+0000","last_became_peered":"2024-09-16T14:55:58.158551+0000","last_unstale":"2024-09-16T15:02:58.354599+0000","last_undegraded":"2024-09-16T15:02:58.354599+0000","last_fullsized":"2024-09-16T15:02:58.354599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:50.370132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292552704,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":265865,"num_read_kb":17015360,"num_write":4464,"num_write_kb":285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"21'4271","reported_seq":258887,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.349452+0000","last_change":"2024-09-16T14:55:58.164363+0000","last_active":"2024-09-16T15:02:58.349452+0000","last_peered":"2024-09-16T15:02:58.349452+0000","last_clean":"2024-09-16T15:02:58.349452+0000","last_became_active":"2024-09-16T14:55:58.160822+0000","last_became_peered":"2024-09-16T14:55:58.160822+0000","last_unstale":"2024-09-16T15:02:58.349452+0000","last_undegraded":"2024-09-16T15:02:58.349452+0000","last_fullsized":"2024-09-16T15:02:58.349452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:43:47.719574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279904256,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":254599,"num_read_kb":16294336,"num_write":4271,"num_write_kb":273344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'4225","reported_seq":290225,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.363544+0000","last_change":"2024-09-16T15:02:58.363926+0000","last_active":"2024-09-16T15:02:58.363544+0000","last_peered":"2024-09-16T15:02:58.363544+0000","last_clean":"2024-09-16T15:02:58.363544+0000","last_became_active":"2024-09-16T14:55:57.741155+0000","last_became_peered":"2024-09-16T14:55:57.741155+0000","last_unstale":"2024-09-16T15:02:58.363544+0000","last_undegraded":"2024-09-16T15:02:58.363544+0000","last_fullsized":"2024-09-16T15:02:58.363544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4225,"log_dups_size":0,"ondisk_log_size":4225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:35:21.693051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824088,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":251676,"num_read_kb":16107201,"num_write":4225,"num_write_kb":270337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4931,"num_bytes_recovered":5170528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4931},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"21'3824","reported_seq":231633,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354290+0000","last_change":"2024-09-16T14:55:58.168716+0000","last_active":"2024-09-16T15:02:58.354290+0000","last_peered":"2024-09-16T15:02:58.354290+0000","last_clean":"2024-09-16T15:02:58.354290+0000","last_became_active":"2024-09-16T14:55:58.167901+0000","last_became_peered":"2024-09-16T14:55:58.167901+0000","last_unstale":"2024-09-16T15:02:58.354290+0000","last_undegraded":"2024-09-16T15:02:58.354290+0000","last_fullsized":"2024-09-16T15:02:58.354290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:34.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250609664,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":227792,"num_read_kb":14578688,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"21'3472","reported_seq":210293,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355178+0000","last_change":"2024-09-16T14:55:57.742732+0000","last_active":"2024-09-16T15:02:58.355178+0000","last_peered":"2024-09-16T15:02:58.355178+0000","last_clean":"2024-09-16T15:02:58.355178+0000","last_became_active":"2024-09-16T14:55:57.741678+0000","last_became_peered":"2024-09-16T14:55:57.741678+0000","last_unstale":"2024-09-16T15:02:58.355178+0000","last_undegraded":"2024-09-16T15:02:58.355178+0000","last_fullsized":"2024-09-16T15:02:58.355178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:04.173960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":206804,"num_read_kb":13235456,"num_write":3472,"num_write_kb":222208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'4016","reported_seq":276054,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.358030+0000","last_change":"2024-09-16T15:02:58.358277+0000","last_active":"2024-09-16T15:02:58.358030+0000","last_peered":"2024-09-16T15:02:58.358030+0000","last_clean":"2024-09-16T15:02:58.358030+0000","last_became_active":"2024-09-16T14:55:57.741046+0000","last_became_peered":"2024-09-16T14:55:57.741046+0000","last_unstale":"2024-09-16T15:02:58.358030+0000","last_undegraded":"2024-09-16T15:02:58.358030+0000","last_fullsized":"2024-09-16T15:02:58.358030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":238837,"num_read_kb":15285568,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4759,"num_bytes_recovered":4990173184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4759},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"21'4160","reported_seq":286044,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352027+0000","last_change":"2024-09-16T15:02:58.206062+0000","last_active":"2024-09-16T15:02:58.352027+0000","last_peered":"2024-09-16T15:02:58.352027+0000","last_clean":"2024-09-16T15:02:58.352027+0000","last_became_active":"2024-09-16T14:55:58.164678+0000","last_became_peered":"2024-09-16T14:55:58.164678+0000","last_unstale":"2024-09-16T15:02:58.352027+0000","last_undegraded":"2024-09-16T15:02:58.352027+0000","last_fullsized":"2024-09-16T15:02:58.352027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":247262,"num_read_kb":15824768,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4971,"num_bytes_recovered":5212471296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4971},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"21'3952","reported_seq":239214,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355622+0000","last_change":"2024-09-16T14:55:58.165301+0000","last_active":"2024-09-16T15:02:58.355622+0000","last_peered":"2024-09-16T15:02:58.355622+0000","last_clean":"2024-09-16T15:02:58.355622+0000","last_became_active":"2024-09-16T14:55:58.164424+0000","last_became_peered":"2024-09-16T14:55:58.164424+0000","last_unstale":"2024-09-16T15:02:58.355622+0000","last_undegraded":"2024-09-16T15:02:58.355622+0000","last_fullsized":"2024-09-16T15:02:58.355622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3952,"log_dups_size":0,"ondisk_log_size":3952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":235245,"num_read_kb":15055680,"num_write":3952,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:50.657576+0000","last_change":"2024-09-16T14:55:50.040247+0000","last_active":"2024-09-16T14:59:50.657576+0000","last_peered":"2024-09-16T14:59:50.657576+0000","last_clean":"2024-09-16T14:59:50.657576+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T14:59:50.657576+0000","last_undegraded":"2024-09-16T14:59:50.657576+0000","last_fullsized":"2024-09-16T14:59:50.657576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"21'4176","reported_seq":252870,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352334+0000","last_change":"2024-09-16T14:55:57.736198+0000","last_active":"2024-09-16T15:02:58.352334+0000","last_peered":"2024-09-16T15:02:58.352334+0000","last_clean":"2024-09-16T15:02:58.352334+0000","last_became_active":"2024-09-16T14:55:57.735457+0000","last_became_peered":"2024-09-16T14:55:57.735457+0000","last_unstale":"2024-09-16T15:02:58.352334+0000","last_undegraded":"2024-09-16T15:02:58.352334+0000","last_fullsized":"2024-09-16T15:02:58.352334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:12:18.970682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":248677,"num_read_kb":15915328,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:59.622709+0000","last_change":"2024-09-16T14:55:50.089023+0000","last_active":"2024-09-16T14:59:59.622709+0000","last_peered":"2024-09-16T14:59:59.622709+0000","last_clean":"2024-09-16T14:59:59.622709+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T14:59:59.622709+0000","last_undegraded":"2024-09-16T14:59:59.622709+0000","last_fullsized":"2024-09-16T14:59:59.622709+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'4016","reported_seq":243216,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352482+0000","last_change":"2024-09-16T14:55:58.161956+0000","last_active":"2024-09-16T15:02:58.352482+0000","last_peered":"2024-09-16T15:02:58.352482+0000","last_clean":"2024-09-16T15:02:58.352482+0000","last_became_active":"2024-09-16T14:55:58.160928+0000","last_became_peered":"2024-09-16T14:55:58.160928+0000","last_unstale":"2024-09-16T15:02:58.352482+0000","last_undegraded":"2024-09-16T15:02:58.352482+0000","last_fullsized":"2024-09-16T15:02:58.352482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:17:01.484904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":239183,"num_read_kb":15307712,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"16'2","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615368+0000","last_change":"2024-09-16T14:55:49.604671+0000","last_active":"2024-09-16T15:00:00.615368+0000","last_peered":"2024-09-16T15:00:00.615368+0000","last_clean":"2024-09-16T15:00:00.615368+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T15:00:00.615368+0000","last_undegraded":"2024-09-16T15:00:00.615368+0000","last_fullsized":"2024-09-16T15:00:00.615368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"21'4144","reported_seq":250709,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.343842+0000","last_change":"2024-09-16T14:55:58.161979+0000","last_active":"2024-09-16T15:02:58.343842+0000","last_peered":"2024-09-16T15:02:58.343842+0000","last_clean":"2024-09-16T15:02:58.343842+0000","last_became_active":"2024-09-16T14:55:58.160444+0000","last_became_peered":"2024-09-16T14:55:58.160444+0000","last_unstale":"2024-09-16T15:02:58.343842+0000","last_undegraded":"2024-09-16T15:02:58.343842+0000","last_fullsized":"2024-09-16T15:02:58.343842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:34.138944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":246548,"num_read_kb":15779072,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"14'1","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.764934+0000","last_change":"2024-09-16T14:55:49.601026+0000","last_active":"2024-09-16T15:00:00.764934+0000","last_peered":"2024-09-16T15:00:00.764934+0000","last_clean":"2024-09-16T15:00:00.764934+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T15:00:00.764934+0000","last_undegraded":"2024-09-16T15:00:00.764934+0000","last_fullsized":"2024-09-16T15:00:00.764934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"21'4160","reported_seq":252366,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356538+0000","last_change":"2024-09-16T14:55:58.164906+0000","last_active":"2024-09-16T15:02:58.356538+0000","last_peered":"2024-09-16T15:02:58.356538+0000","last_clean":"2024-09-16T15:02:58.356538+0000","last_became_active":"2024-09-16T14:55:58.164104+0000","last_became_peered":"2024-09-16T14:55:58.164104+0000","last_unstale":"2024-09-16T15:02:58.356538+0000","last_undegraded":"2024-09-16T15:02:58.356538+0000","last_fullsized":"2024-09-16T15:02:58.356538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":248189,"num_read_kb":15884096,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4432","reported_seq":268128,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354016+0000","last_change":"2024-09-16T14:55:57.741019+0000","last_active":"2024-09-16T15:02:58.354016+0000","last_peered":"2024-09-16T15:02:58.354016+0000","last_clean":"2024-09-16T15:02:58.354016+0000","last_became_active":"2024-09-16T14:55:57.740121+0000","last_became_peered":"2024-09-16T14:55:57.740121+0000","last_unstale":"2024-09-16T15:02:58.354016+0000","last_undegraded":"2024-09-16T15:02:58.354016+0000","last_fullsized":"2024-09-16T15:02:58.354016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:55.266300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":263679,"num_read_kb":16875456,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.768498+0000","last_change":"2024-09-16T14:55:49.600852+0000","last_active":"2024-09-16T15:00:00.768498+0000","last_peered":"2024-09-16T15:00:00.768498+0000","last_clean":"2024-09-16T15:00:00.768498+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T15:00:00.768498+0000","last_undegraded":"2024-09-16T15:00:00.768498+0000","last_fullsized":"2024-09-16T15:00:00.768498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'4240","reported_seq":291412,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356282+0000","last_change":"2024-09-16T15:02:58.315413+0000","last_active":"2024-09-16T15:02:58.356282+0000","last_peered":"2024-09-16T15:02:58.356282+0000","last_clean":"2024-09-16T15:02:58.356282+0000","last_became_active":"2024-09-16T14:55:57.737731+0000","last_became_peered":"2024-09-16T14:55:57.737731+0000","last_unstale":"2024-09-16T15:02:58.356282+0000","last_undegraded":"2024-09-16T15:02:58.356282+0000","last_fullsized":"2024-09-16T15:02:58.356282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:33:09.843078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":252293,"num_read_kb":16146752,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5005,"num_bytes_recovered":5248122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5005},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615388+0000","last_change":"2024-09-16T14:55:49.603629+0000","last_active":"2024-09-16T15:00:00.615388+0000","last_peered":"2024-09-16T15:00:00.615388+0000","last_clean":"2024-09-16T15:00:00.615388+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T15:00:00.615388+0000","last_undegraded":"2024-09-16T15:00:00.615388+0000","last_fullsized":"2024-09-16T15:00:00.615388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"21'4256","reported_seq":257533,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355605+0000","last_change":"2024-09-16T14:55:58.161552+0000","last_active":"2024-09-16T15:02:58.355605+0000","last_peered":"2024-09-16T15:02:58.355605+0000","last_clean":"2024-09-16T15:02:58.355605+0000","last_became_active":"2024-09-16T14:55:58.160681+0000","last_became_peered":"2024-09-16T14:55:58.160681+0000","last_unstale":"2024-09-16T15:02:58.355605+0000","last_undegraded":"2024-09-16T15:02:58.355605+0000","last_fullsized":"2024-09-16T15:02:58.355605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253260,"num_read_kb":16208640,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:10.665440+0000","last_change":"2024-09-16T14:55:50.040167+0000","last_active":"2024-09-16T15:00:10.665440+0000","last_peered":"2024-09-16T15:00:10.665440+0000","last_clean":"2024-09-16T15:00:10.665440+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T15:00:10.665440+0000","last_undegraded":"2024-09-16T15:00:10.665440+0000","last_fullsized":"2024-09-16T15:00:10.665440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:09.624095+0000","last_change":"2024-09-16T14:55:50.089122+0000","last_active":"2024-09-16T15:00:09.624095+0000","last_peered":"2024-09-16T15:00:09.624095+0000","last_clean":"2024-09-16T15:00:09.624095+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T15:00:09.624095+0000","last_undegraded":"2024-09-16T15:00:09.624095+0000","last_fullsized":"2024-09-16T15:00:09.624095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"21'4256","reported_seq":291790,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354087+0000","last_change":"2024-09-16T15:02:58.350569+0000","last_active":"2024-09-16T15:02:58.354087+0000","last_peered":"2024-09-16T15:02:58.354087+0000","last_clean":"2024-09-16T15:02:58.354087+0000","last_became_active":"2024-09-16T14:55:58.164766+0000","last_became_peered":"2024-09-16T14:55:58.164766+0000","last_unstale":"2024-09-16T15:02:58.354087+0000","last_undegraded":"2024-09-16T15:02:58.354087+0000","last_fullsized":"2024-09-16T15:02:58.354087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253030,"num_read_kb":16193920,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4949,"num_bytes_recovered":5189402624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4949},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4329504792,"num_objects":4130,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66064,"num_write_kb":4228033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12988526592,"data_stored":12988514376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66064,"ondisk_log_size":66064,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640345,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2198332,"kb_used_data":2131124,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92173508,"statfs":{"total":96636764160,"available":94385672192,"internally_reserved":0,"allocated":2182270976,"data_stored":2182145596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.44400000000000001},"min":{"1min":0.23000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.498,"5min":0.70199999999999996,"15min":1.6399999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.48999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.75900000000000001,"15min":1.4039999999999999},"last":0.376}]},{"osd":1,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.73299999999999998,"5min":0.97599999999999998,"15min":1.079},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.44500000000000001},"min":{"1min":0.24099999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.45900000000000002,"5min":1.0529999999999999,"15min":1.1819999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.52700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.58399999999999996,"5min":1.681,"15min":1.681},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66200000000000003,"5min":0.94499999999999995,"15min":1.1020000000000001},"last":0.29799999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.76200000000000001,"15min":1.274},"last":0.255},{"interface":"front","average":{"1min":0.378,"5min":0.375,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56299999999999994,"5min":0.90000000000000002,"15min":1.5249999999999999},"last":0.318}]},{"osd":5,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.378,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":1.0109999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.504},"min":{"1min":0.27000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55000000000000004,"5min":0.74199999999999999,"15min":1.347},"last":0.48799999999999999}]}]},{"osd":3,"up_from":11,"seq":47244640346,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2685692,"kb_used_data":2614388,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":91686148,"statfs":{"total":96636764160,"available":93886615552,"internally_reserved":0,"allocated":2677133312,"data_stored":2677007937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.45800000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":2.1309999999999998},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.47999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":0.88100000000000001,"5min":1.377,"15min":1.377},"last":0.88100000000000001}]},{"osd":1,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40699999999999997,"15min":0.53900000000000003},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.85099999999999998,"5min":1.587,"15min":1.8540000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38800000000000001,"15min":0.52700000000000002},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.80200000000000005,"5min":1.1919999999999999,"15min":2.504},"last":0.80200000000000005}]},{"osd":2,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":1.8080000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":2.3679999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.46000000000000002},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.71899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.51000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":1.883},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.60599999999999998},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.68000000000000005,"5min":0.996,"15min":3.968},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.82899999999999996,"5min":1.359,"15min":1.359},"last":0.82899999999999996}]}]},{"osd":2,"up_from":11,"seq":47244640345,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1662076,"kb_used_data":1604724,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":92709764,"statfs":{"total":96636764160,"available":94934798336,"internally_reserved":0,"allocated":1643237376,"data_stored":1643112001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26200000000000001,"15min":0.33500000000000002},"min":{"1min":0.17799999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42299999999999999,"5min":0.79400000000000004,"15min":1.222},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36699999999999999,"15min":0.42799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.64700000000000002,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.86799999999999999,"15min":0.57199999999999995},"min":{"1min":0.19500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71099999999999997,"5min":53.473999999999997,"15min":53.473999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.81100000000000005,"15min":0.58799999999999997},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":0.51800000000000002,"5min":53.326000000000001,"15min":53.326000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.47599999999999998},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1950000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.26200000000000001},"max":{"1min":0.72999999999999998,"5min":1.839,"15min":1.839},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":1.8380000000000001},"last":0.877},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61899999999999999,"5min":0.65900000000000003,"15min":0.92900000000000005},"last":0.68999999999999995}]},{"osd":5,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.016,"15min":0.70899999999999996},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":58.322000000000003,"15min":58.322000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.91900000000000004,"15min":0.70999999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":58.619,"15min":58.619},"last":0.94099999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640345,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2613052,"kb_used_data":2393268,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":91758788,"statfs":{"total":96636764160,"available":93960998912,"internally_reserved":0,"allocated":2450706432,"data_stored":2450581057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[2,1,0,0,2,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.253,"15min":0.29599999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.41099999999999998,"5min":0.60199999999999998,"15min":0.72499999999999998},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.307,"15min":0.33500000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16400000000000001},"max":{"1min":0.54800000000000004,"5min":0.61099999999999999,"15min":0.77500000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.26200000000000001,"15min":0.34100000000000003},"min":{"1min":0.182,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.51900000000000002,"5min":0.64900000000000002,"15min":0.73299999999999998},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.33000000000000002,"15min":0.375},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.60299999999999998,"15min":0.88400000000000001},"last":0.312}]},{"osd":3,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.748,"15min":0.60899999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61299999999999999,"5min":30.193000000000001,"15min":30.193000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.69999999999999996,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":30.173999999999999,"15min":30.173999999999999},"last":0.69299999999999995}]},{"osd":4,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38300000000000001,"15min":0.45600000000000002},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.68500000000000005,"15min":1.0860000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45500000000000002,"15min":0.51700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57199999999999995,"5min":0.89800000000000002,"15min":1.325},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40600000000000003,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.59199999999999997,"5min":0.98299999999999998,"15min":1.036},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.438,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.48699999999999999,"5min":0.97199999999999998,"15min":1.2829999999999999},"last":0.432}]}]},{"osd":5,"up_from":11,"seq":47244640345,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1334456,"kb_used_data":1285296,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":93037384,"statfs":{"total":96636764160,"available":95270281216,"internally_reserved":0,"allocated":1316143104,"data_stored":1316021801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50330055},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.38300000000000001,"15min":0.46899999999999997},"min":{"1min":0.22900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.52300000000000002},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.536},"last":0.40100000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":1.343,"15min":0.80300000000000005},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":2.3149999999999999,"5min":79.933999999999997,"15min":79.933999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":1.325,"15min":0.78500000000000003},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.90600000000000003,"5min":79.793999999999997,"15min":79.793999999999997},"last":0.26400000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.54500000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":1.6180000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.41799999999999998,"15min":0.49199999999999999},"min":{"1min":0.31900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.5940000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.376,"15min":0.53200000000000003},"min":{"1min":0.22500000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.359},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.5},"min":{"1min":0.26300000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Mon Sep 16 15:01:58 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.38,"15min":0.498},"min":{"1min":0.25700000000000001,"5min":0.216,"15min":0.216},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.458},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.434,"15min":0.51400000000000001},"min":{"1min":0.30399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.35499999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640346,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2749756,"kb_used_data":2656372,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":91622084,"statfs":{"total":96636764160,"available":93821014016,"internally_reserved":0,"allocated":2720124928,"data_stored":2719999548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.26600000000000001,"15min":0.39500000000000002},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.45400000000000001,"5min":1.026,"15min":2.4620000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.30399999999999999,"15min":0.437},"min":{"1min":0.216,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":1.0369999999999999,"15min":2.5030000000000001},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.27800000000000002,"15min":0.36699999999999999},"min":{"1min":0.20200000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.318,"5min":0.34799999999999998,"15min":0.38400000000000001},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65400000000000003}]},{"osd":3,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.71399999999999997,"15min":0.60599999999999998},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":33.82,"15min":33.82},"last":0.999},{"interface":"front","average":{"1min":0.374,"5min":0.69599999999999995,"15min":0.58299999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79100000000000004,"5min":32.356000000000002,"15min":32.356000000000002},"last":0.78900000000000003}]},{"osd":4,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57499999999999996,"5min":0.92500000000000004,"15min":2.8780000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.86499999999999999},"last":0.72799999999999998}]},{"osd":5,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39300000000000002,"15min":5.8540000000000001},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.47399999999999998,"5min":0.63,"15min":143.86699999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.442,"15min":0.56499999999999995},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56200000000000006,"5min":0.98299999999999998,"15min":2.9449999999999998},"last":0.82799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2719940608,"data_stored":2719940608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2450526208,"data_stored":2450522136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643057152,"data_stored":1643053080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2676953088,"data_stored":2676949016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2182086656,"data_stored":2182086656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1315962880,"data_stored":1315962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:03:06.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T15:03:06.533 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:06.533 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"9ad57213-02ce-4767-b3ba-f402828e922a","created":"2024-09-16T14:55:35.753903+0000","modified":"2024-09-16T14:55:58.718294+0000","last_up_change":"2024-09-16T14:55:44.548974+0000","last_in_change":"2024-09-16T14:55:37.619170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-16T14:55:45.899858+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"test","create_time":"2024-09-16T14:55:55.518017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"64cb5343-f41e-43ff-9cee-a9356579c0cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6808","nonce":934526015}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6809","nonce":934526015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6811","nonce":934526015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6810","nonce":934526015}]},"public_addr":"172.21.15.79:6808/934526015","cluster_addr":"172.21.15.79:6809/934526015","heartbeat_back_addr":"172.21.15.79:6811/934526015","heartbeat_front_addr":"172.21.15.79:6810/934526015","state":["exists","up"]},{"osd":1,"uuid":"d0b0e774-5d6d-408f-a324-4bd14d56a1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6804","nonce":3624226452}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6805","nonce":3624226452}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6807","nonce":3624226452}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6806","nonce":3624226452}]},"public_addr":"172.21.15.79:6804/3624226452","cluster_addr":"172.21.15.79:6805/3624226452","heartbeat_back_addr":"172.21.15.79:6807/3624226452","heartbeat_front_addr":"172.21.15.79:6806/3624226452","state":["exists","up"]},{"osd":2,"uuid":"f2e06962-b2f6-4d7a-bed0-a97f3e826f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6800","nonce":14125057}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6801","nonce":14125057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6803","nonce":14125057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.79:6802","nonce":14125057}]},"public_addr":"172.21.15.79:6800/14125057","cluster_addr":"172.21.15.79:6801/14125057","heartbeat_back_addr":"172.21.15.79:6803/14125057","heartbeat_front_addr":"172.21.15.79:6802/14125057","state":["exists","up"]},{"osd":3,"uuid":"e03f2627-38a0-4d8b-a152-cc5e016cfe1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6804","nonce":3934315852}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6805","nonce":3934315852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6807","nonce":3934315852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6806","nonce":3934315852}]},"public_addr":"172.21.15.116:6804/3934315852","cluster_addr":"172.21.15.116:6805/3934315852","heartbeat_back_addr":"172.21.15.116:6807/3934315852","heartbeat_front_addr":"172.21.15.116:6806/3934315852","state":["exists","up"]},{"osd":4,"uuid":"abd75d6d-8bfa-4557-ac6b-fe094f742786","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6808","nonce":1855349945}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6809","nonce":1855349945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6811","nonce":1855349945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6810","nonce":1855349945}]},"public_addr":"172.21.15.116:6808/1855349945","cluster_addr":"172.21.15.116:6809/1855349945","heartbeat_back_addr":"172.21.15.116:6811/1855349945","heartbeat_front_addr":"172.21.15.116:6810/1855349945","state":["exists","up"]},{"osd":5,"uuid":"b8325629-8a43-4e9b-b43c-c26a274c1305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6800","nonce":2171612314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6801","nonce":2171612314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6803","nonce":2171612314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.116:6802","nonce":2171612314}]},"public_addr":"172.21.15.116:6800/2171612314","cluster_addr":"172.21.15.116:6801/2171612314","heartbeat_back_addr":"172.21.15.116:6803/2171612314","heartbeat_front_addr":"172.21.15.116:6802/2171612314","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.157553+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.025771+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:42.691382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.011870+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:42.995746+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:55:43.012939+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T15:03:07.551 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T15:03:07.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:03:07.702 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-16T15:03:07.702 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:03:07.703 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-16T15:03:07.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T15:03:07.992 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T15:03:08.009 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T15:03:08.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:03:08.149 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-16T15:03:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:03:08.149 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-16T15:03:08.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T15:03:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T15:03:08.470 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T15:03:08.471 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:03:08.609 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-16T15:03:08.609 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:03:08.609 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-16T15:03:08.624 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T15:03:08.881 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T15:03:08.898 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T15:03:08.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:03:09.025 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-16T15:03:09.026 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:03:09.026 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-16T15:03:09.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T15:03:09.304 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T15:03:09.320 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T15:03:09.320 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:03:09.478 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-16T15:03:09.479 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:03:09.479 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-16T15:03:09.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T15:03:09.828 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T15:03:09.853 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T15:03:09.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T15:03:10.106 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-16T15:03:10.106 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T15:03:10.106 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-16T15:03:10.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T15:03:10.439 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T15:03:10.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:03:10.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:10.727 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T15:03:10.742 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-16T15:03:10.627603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4329504811,"num_objects":4132,"num_object_clones":0,"num_object_copies":12394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66066,"num_write_kb":4228035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66067,"ondisk_log_size":66067,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":13243364,"kb_used_data":12685172,"kb_used_omap":9,"kb_used_meta":558134,"kb_avail":552987676,"statfs":{"total":579820584960,"available":566259380224,"internally_reserved":0,"allocated":12989616128,"data_stored":12988867940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":571529895},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-2,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30349,"num_read_kb":1942336,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":168820736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":161},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003600"},"pg_stats":[{"pgid":"2.f","version":"21'4464","reported_seq":270353,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354599+0000","last_change":"2024-09-16T14:55:58.159577+0000","last_active":"2024-09-16T15:02:58.354599+0000","last_peered":"2024-09-16T15:02:58.354599+0000","last_clean":"2024-09-16T15:02:58.354599+0000","last_became_active":"2024-09-16T14:55:58.158551+0000","last_became_peered":"2024-09-16T14:55:58.158551+0000","last_unstale":"2024-09-16T15:02:58.354599+0000","last_undegraded":"2024-09-16T15:02:58.354599+0000","last_fullsized":"2024-09-16T15:02:58.354599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:17:50.370132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292552704,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":265865,"num_read_kb":17015360,"num_write":4464,"num_write_kb":285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"21'4271","reported_seq":258887,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.349452+0000","last_change":"2024-09-16T14:55:58.164363+0000","last_active":"2024-09-16T15:02:58.349452+0000","last_peered":"2024-09-16T15:02:58.349452+0000","last_clean":"2024-09-16T15:02:58.349452+0000","last_became_active":"2024-09-16T14:55:58.160822+0000","last_became_peered":"2024-09-16T14:55:58.160822+0000","last_unstale":"2024-09-16T15:02:58.349452+0000","last_undegraded":"2024-09-16T15:02:58.349452+0000","last_fullsized":"2024-09-16T15:02:58.349452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:43:47.719574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279904256,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":254599,"num_read_kb":16294336,"num_write":4271,"num_write_kb":273344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'4225","reported_seq":290225,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.363544+0000","last_change":"2024-09-16T15:02:58.363926+0000","last_active":"2024-09-16T15:02:58.363544+0000","last_peered":"2024-09-16T15:02:58.363544+0000","last_clean":"2024-09-16T15:02:58.363544+0000","last_became_active":"2024-09-16T14:55:57.741155+0000","last_became_peered":"2024-09-16T14:55:57.741155+0000","last_unstale":"2024-09-16T15:02:58.363544+0000","last_undegraded":"2024-09-16T15:02:58.363544+0000","last_fullsized":"2024-09-16T15:02:58.363544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4225,"log_dups_size":0,"ondisk_log_size":4225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:35:21.693051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824088,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":251676,"num_read_kb":16107201,"num_write":4225,"num_write_kb":270337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4931,"num_bytes_recovered":5170528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4931},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"21'3824","reported_seq":231633,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354290+0000","last_change":"2024-09-16T14:55:58.168716+0000","last_active":"2024-09-16T15:02:58.354290+0000","last_peered":"2024-09-16T15:02:58.354290+0000","last_clean":"2024-09-16T15:02:58.354290+0000","last_became_active":"2024-09-16T14:55:58.167901+0000","last_became_peered":"2024-09-16T14:55:58.167901+0000","last_unstale":"2024-09-16T15:02:58.354290+0000","last_undegraded":"2024-09-16T15:02:58.354290+0000","last_fullsized":"2024-09-16T15:02:58.354290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3824,"log_dups_size":0,"ondisk_log_size":3824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:18:34.015060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250609664,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":227792,"num_read_kb":14578688,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"21'3472","reported_seq":210293,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355178+0000","last_change":"2024-09-16T14:55:57.742732+0000","last_active":"2024-09-16T15:02:58.355178+0000","last_peered":"2024-09-16T15:02:58.355178+0000","last_clean":"2024-09-16T15:02:58.355178+0000","last_became_active":"2024-09-16T14:55:57.741678+0000","last_became_peered":"2024-09-16T14:55:57.741678+0000","last_unstale":"2024-09-16T15:02:58.355178+0000","last_undegraded":"2024-09-16T15:02:58.355178+0000","last_fullsized":"2024-09-16T15:02:58.355178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:04:04.173960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":206804,"num_read_kb":13235456,"num_write":3472,"num_write_kb":222208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'4016","reported_seq":276054,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.358030+0000","last_change":"2024-09-16T15:02:58.358277+0000","last_active":"2024-09-16T15:02:58.358030+0000","last_peered":"2024-09-16T15:02:58.358030+0000","last_clean":"2024-09-16T15:02:58.358030+0000","last_became_active":"2024-09-16T14:55:57.741046+0000","last_became_peered":"2024-09-16T14:55:57.741046+0000","last_unstale":"2024-09-16T15:02:58.358030+0000","last_undegraded":"2024-09-16T15:02:58.358030+0000","last_fullsized":"2024-09-16T15:02:58.358030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":238837,"num_read_kb":15285568,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4759,"num_bytes_recovered":4990173184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4759},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"21'4160","reported_seq":286044,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352027+0000","last_change":"2024-09-16T15:02:58.206062+0000","last_active":"2024-09-16T15:02:58.352027+0000","last_peered":"2024-09-16T15:02:58.352027+0000","last_clean":"2024-09-16T15:02:58.352027+0000","last_became_active":"2024-09-16T14:55:58.164678+0000","last_became_peered":"2024-09-16T14:55:58.164678+0000","last_unstale":"2024-09-16T15:02:58.352027+0000","last_undegraded":"2024-09-16T15:02:58.352027+0000","last_fullsized":"2024-09-16T15:02:58.352027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":247262,"num_read_kb":15824768,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4971,"num_bytes_recovered":5212471296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4971},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"21'3952","reported_seq":239214,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355622+0000","last_change":"2024-09-16T14:55:58.165301+0000","last_active":"2024-09-16T15:02:58.355622+0000","last_peered":"2024-09-16T15:02:58.355622+0000","last_clean":"2024-09-16T15:02:58.355622+0000","last_became_active":"2024-09-16T14:55:58.164424+0000","last_became_peered":"2024-09-16T14:55:58.164424+0000","last_unstale":"2024-09-16T15:02:58.355622+0000","last_undegraded":"2024-09-16T15:02:58.355622+0000","last_fullsized":"2024-09-16T15:02:58.355622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3952,"log_dups_size":0,"ondisk_log_size":3952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":235245,"num_read_kb":15055680,"num_write":3952,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:50.657576+0000","last_change":"2024-09-16T14:55:50.040247+0000","last_active":"2024-09-16T14:59:50.657576+0000","last_peered":"2024-09-16T14:59:50.657576+0000","last_clean":"2024-09-16T14:59:50.657576+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T14:59:50.657576+0000","last_undegraded":"2024-09-16T14:59:50.657576+0000","last_fullsized":"2024-09-16T14:59:50.657576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"21'4176","reported_seq":252870,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352334+0000","last_change":"2024-09-16T14:55:57.736198+0000","last_active":"2024-09-16T15:02:58.352334+0000","last_peered":"2024-09-16T15:02:58.352334+0000","last_clean":"2024-09-16T15:02:58.352334+0000","last_became_active":"2024-09-16T14:55:57.735457+0000","last_became_peered":"2024-09-16T14:55:57.735457+0000","last_unstale":"2024-09-16T15:02:58.352334+0000","last_undegraded":"2024-09-16T15:02:58.352334+0000","last_fullsized":"2024-09-16T15:02:58.352334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4176,"log_dups_size":0,"ondisk_log_size":4176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:12:18.970682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":248677,"num_read_kb":15915328,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T14:59:59.622709+0000","last_change":"2024-09-16T14:55:50.089023+0000","last_active":"2024-09-16T14:59:59.622709+0000","last_peered":"2024-09-16T14:59:59.622709+0000","last_clean":"2024-09-16T14:59:59.622709+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T14:59:59.622709+0000","last_undegraded":"2024-09-16T14:59:59.622709+0000","last_fullsized":"2024-09-16T14:59:59.622709+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:53:37.824529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'4016","reported_seq":243216,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.352482+0000","last_change":"2024-09-16T14:55:58.161956+0000","last_active":"2024-09-16T15:02:58.352482+0000","last_peered":"2024-09-16T15:02:58.352482+0000","last_clean":"2024-09-16T15:02:58.352482+0000","last_became_active":"2024-09-16T14:55:58.160928+0000","last_became_peered":"2024-09-16T14:55:58.160928+0000","last_unstale":"2024-09-16T15:02:58.352482+0000","last_undegraded":"2024-09-16T15:02:58.352482+0000","last_fullsized":"2024-09-16T15:02:58.352482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:17:01.484904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":239183,"num_read_kb":15307712,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"16'2","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615368+0000","last_change":"2024-09-16T14:55:49.604671+0000","last_active":"2024-09-16T15:00:00.615368+0000","last_peered":"2024-09-16T15:00:00.615368+0000","last_clean":"2024-09-16T15:00:00.615368+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T15:00:00.615368+0000","last_undegraded":"2024-09-16T15:00:00.615368+0000","last_fullsized":"2024-09-16T15:00:00.615368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"21'4144","reported_seq":250709,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.343842+0000","last_change":"2024-09-16T14:55:58.161979+0000","last_active":"2024-09-16T15:02:58.343842+0000","last_peered":"2024-09-16T15:02:58.343842+0000","last_clean":"2024-09-16T15:02:58.343842+0000","last_became_active":"2024-09-16T14:55:58.160444+0000","last_became_peered":"2024-09-16T14:55:58.160444+0000","last_unstale":"2024-09-16T15:02:58.343842+0000","last_undegraded":"2024-09-16T15:02:58.343842+0000","last_fullsized":"2024-09-16T15:02:58.343842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:34.138944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":246548,"num_read_kb":15779072,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"14'1","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.764934+0000","last_change":"2024-09-16T14:55:49.601026+0000","last_active":"2024-09-16T15:00:00.764934+0000","last_peered":"2024-09-16T15:00:00.764934+0000","last_clean":"2024-09-16T15:00:00.764934+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T15:00:00.764934+0000","last_undegraded":"2024-09-16T15:00:00.764934+0000","last_fullsized":"2024-09-16T15:00:00.764934+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:14.628205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"21'4160","reported_seq":252366,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356538+0000","last_change":"2024-09-16T14:55:58.164906+0000","last_active":"2024-09-16T15:02:58.356538+0000","last_peered":"2024-09-16T15:02:58.356538+0000","last_clean":"2024-09-16T15:02:58.356538+0000","last_became_active":"2024-09-16T14:55:58.164104+0000","last_became_peered":"2024-09-16T14:55:58.164104+0000","last_unstale":"2024-09-16T15:02:58.356538+0000","last_undegraded":"2024-09-16T15:02:58.356538+0000","last_fullsized":"2024-09-16T15:02:58.356538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:41:18.277565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":248189,"num_read_kb":15884096,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4432","reported_seq":268128,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354016+0000","last_change":"2024-09-16T14:55:57.741019+0000","last_active":"2024-09-16T15:02:58.354016+0000","last_peered":"2024-09-16T15:02:58.354016+0000","last_clean":"2024-09-16T15:02:58.354016+0000","last_became_active":"2024-09-16T14:55:57.740121+0000","last_became_peered":"2024-09-16T14:55:57.740121+0000","last_unstale":"2024-09-16T15:02:58.354016+0000","last_undegraded":"2024-09-16T15:02:58.354016+0000","last_fullsized":"2024-09-16T15:02:58.354016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4432,"log_dups_size":0,"ondisk_log_size":4432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:55.266300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":263679,"num_read_kb":16875456,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.768498+0000","last_change":"2024-09-16T14:55:49.600852+0000","last_active":"2024-09-16T15:00:00.768498+0000","last_peered":"2024-09-16T15:00:00.768498+0000","last_clean":"2024-09-16T15:00:00.768498+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T15:00:00.768498+0000","last_undegraded":"2024-09-16T15:00:00.768498+0000","last_fullsized":"2024-09-16T15:00:00.768498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'4240","reported_seq":291412,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356282+0000","last_change":"2024-09-16T15:02:58.315413+0000","last_active":"2024-09-16T15:02:58.356282+0000","last_peered":"2024-09-16T15:02:58.356282+0000","last_clean":"2024-09-16T15:02:58.356282+0000","last_became_active":"2024-09-16T14:55:57.737731+0000","last_became_peered":"2024-09-16T14:55:57.737731+0000","last_unstale":"2024-09-16T15:02:58.356282+0000","last_undegraded":"2024-09-16T15:02:58.356282+0000","last_fullsized":"2024-09-16T15:02:58.356282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:33:09.843078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":252293,"num_read_kb":16146752,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5005,"num_bytes_recovered":5248122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5005},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:00.615388+0000","last_change":"2024-09-16T14:55:49.603629+0000","last_active":"2024-09-16T15:00:00.615388+0000","last_peered":"2024-09-16T15:00:00.615388+0000","last_clean":"2024-09-16T15:00:00.615388+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T15:00:00.615388+0000","last_undegraded":"2024-09-16T15:00:00.615388+0000","last_fullsized":"2024-09-16T15:00:00.615388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:03.378816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"21'4256","reported_seq":257533,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.355605+0000","last_change":"2024-09-16T14:55:58.161552+0000","last_active":"2024-09-16T15:02:58.355605+0000","last_peered":"2024-09-16T15:02:58.355605+0000","last_clean":"2024-09-16T15:02:58.355605+0000","last_became_active":"2024-09-16T14:55:58.160681+0000","last_became_peered":"2024-09-16T14:55:58.160681+0000","last_unstale":"2024-09-16T15:02:58.355605+0000","last_undegraded":"2024-09-16T15:02:58.355605+0000","last_fullsized":"2024-09-16T15:02:58.355605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:18:56.293673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253260,"num_read_kb":16208640,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:10.665440+0000","last_change":"2024-09-16T14:55:50.040167+0000","last_active":"2024-09-16T15:00:10.665440+0000","last_peered":"2024-09-16T15:00:10.665440+0000","last_clean":"2024-09-16T15:00:10.665440+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T15:00:10.665440+0000","last_undegraded":"2024-09-16T15:00:10.665440+0000","last_fullsized":"2024-09-16T15:00:10.665440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:45.056367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:00:09.624095+0000","last_change":"2024-09-16T14:55:50.089122+0000","last_active":"2024-09-16T15:00:09.624095+0000","last_peered":"2024-09-16T15:00:09.624095+0000","last_clean":"2024-09-16T15:00:09.624095+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T15:00:09.624095+0000","last_undegraded":"2024-09-16T15:00:09.624095+0000","last_fullsized":"2024-09-16T15:00:09.624095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:46.574352+0000","last_clean_scrub_stamp":"2024-09-16T14:55:46.574352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:31:56.422547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"21'4256","reported_seq":291790,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.354087+0000","last_change":"2024-09-16T15:02:58.350569+0000","last_active":"2024-09-16T15:02:58.354087+0000","last_peered":"2024-09-16T15:02:58.354087+0000","last_clean":"2024-09-16T15:02:58.354087+0000","last_became_active":"2024-09-16T14:55:58.164766+0000","last_became_peered":"2024-09-16T14:55:58.164766+0000","last_unstale":"2024-09-16T15:02:58.354087+0000","last_undegraded":"2024-09-16T15:02:58.354087+0000","last_fullsized":"2024-09-16T15:02:58.354087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:10:06.414590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253030,"num_read_kb":16193920,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4949,"num_bytes_recovered":5189402624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4949},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4329504792,"num_objects":4130,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66064,"num_write_kb":4228033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12988526592,"data_stored":12988514376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66064,"ondisk_log_size":66064,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640346,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2198332,"kb_used_data":2131124,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":92173508,"statfs":{"total":96636764160,"available":94385672192,"internally_reserved":0,"allocated":2182270976,"data_stored":2182145596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.44400000000000001},"min":{"1min":0.23000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.498,"5min":0.70199999999999996,"15min":1.6399999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.48999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.75900000000000001,"15min":1.4039999999999999},"last":0.89200000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.73299999999999998,"5min":0.97599999999999998,"15min":1.079},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.44500000000000001},"min":{"1min":0.24099999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.45900000000000002,"5min":1.0529999999999999,"15min":1.1819999999999999},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.52700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.58399999999999996,"5min":1.681,"15min":1.681},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66200000000000003,"5min":0.94499999999999995,"15min":1.1020000000000001},"last":0.74399999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.76200000000000001,"15min":1.274},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.378,"5min":0.375,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56299999999999994,"5min":0.90000000000000002,"15min":1.5249999999999999},"last":0.79100000000000004}]},{"osd":5,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.378,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":1.0109999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.504},"min":{"1min":0.27000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55000000000000004,"5min":0.74199999999999999,"15min":1.347},"last":0.70399999999999996}]}]},{"osd":3,"up_from":11,"seq":47244640347,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2685692,"kb_used_data":2614388,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":91686148,"statfs":{"total":96636764160,"available":93886615552,"internally_reserved":0,"allocated":2677133312,"data_stored":2677007937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.45800000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":2.1309999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.47999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":0.88100000000000001,"5min":1.377,"15min":1.377},"last":0.81100000000000005}]},{"osd":1,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40699999999999997,"15min":0.53900000000000003},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.85099999999999998,"5min":1.587,"15min":1.8540000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38800000000000001,"15min":0.52700000000000002},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.80200000000000005,"5min":1.1919999999999999,"15min":2.504},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":1.8080000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":2.3679999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.46000000000000002},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.71899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.51000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":1.883},"last":0.52400000000000002}]},{"osd":5,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.60599999999999998},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.68000000000000005,"5min":0.996,"15min":3.968},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.82899999999999996,"5min":1.359,"15min":1.359},"last":0.76400000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640346,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1662076,"kb_used_data":1604724,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":92709764,"statfs":{"total":96636764160,"available":94934798336,"internally_reserved":0,"allocated":1643237376,"data_stored":1643112001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26200000000000001,"15min":0.33500000000000002},"min":{"1min":0.17799999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42299999999999999,"5min":0.79400000000000004,"15min":1.222},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36699999999999999,"15min":0.42799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.64700000000000002,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.86799999999999999,"15min":0.57199999999999995},"min":{"1min":0.19500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71099999999999997,"5min":53.473999999999997,"15min":53.473999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.81100000000000005,"15min":0.58799999999999997},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":0.51800000000000002,"5min":53.326000000000001,"15min":53.326000000000001},"last":0.75}]},{"osd":3,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.47599999999999998},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1950000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.26200000000000001},"max":{"1min":0.72999999999999998,"5min":1.839,"15min":1.839},"last":0.878}]},{"osd":4,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":1.8380000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61899999999999999,"5min":0.65900000000000003,"15min":0.92900000000000005},"last":0.70599999999999996}]},{"osd":5,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.016,"15min":0.70899999999999996},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":58.322000000000003,"15min":58.322000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.91900000000000004,"15min":0.70999999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":58.619,"15min":58.619},"last":0.85099999999999998}]}]},{"osd":1,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2613052,"kb_used_data":2393268,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":91758788,"statfs":{"total":96636764160,"available":93960998912,"internally_reserved":0,"allocated":2450706432,"data_stored":2450581057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.253,"15min":0.29599999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.41099999999999998,"5min":0.60199999999999998,"15min":0.72499999999999998},"last":0.626},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.307,"15min":0.33500000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16400000000000001},"max":{"1min":0.54800000000000004,"5min":0.61099999999999999,"15min":0.77500000000000002},"last":0.69399999999999995}]},{"osd":2,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.26200000000000001,"15min":0.34100000000000003},"min":{"1min":0.182,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.51900000000000002,"5min":0.64900000000000002,"15min":0.73299999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.33000000000000002,"15min":0.375},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.60299999999999998,"15min":0.88400000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.748,"15min":0.60899999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61299999999999999,"5min":30.193000000000001,"15min":30.193000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.69999999999999996,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":30.173999999999999,"15min":30.173999999999999},"last":0.64700000000000002}]},{"osd":4,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38300000000000001,"15min":0.45600000000000002},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.68500000000000005,"15min":1.0860000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45500000000000002,"15min":0.51700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57199999999999995,"5min":0.89800000000000002,"15min":1.325},"last":0.84699999999999998}]},{"osd":5,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40600000000000003,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.59199999999999997,"5min":0.98299999999999998,"15min":1.036},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.438,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.48699999999999999,"5min":0.97199999999999998,"15min":1.2829999999999999},"last":0.81999999999999995}]}]},{"osd":5,"up_from":11,"seq":47244640347,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1334456,"kb_used_data":1285296,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":93037384,"statfs":{"total":96636764160,"available":95270281216,"internally_reserved":0,"allocated":1316143104,"data_stored":1316021801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50330055},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.377,"15min":0.45800000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.89000000000000001,"5min":2.286,"15min":2.286},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.51100000000000001},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.78800000000000003,"5min":1.103,"15min":1.536},"last":0.98499999999999999}]},{"osd":1,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":1.3500000000000001,"15min":0.79700000000000004},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.74299999999999999,"5min":79.933999999999997,"15min":79.933999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.40200000000000002,"5min":1.327,"15min":0.77700000000000002},"min":{"1min":0.246,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71099999999999997,"5min":79.793999999999997,"15min":79.793999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.82699999999999996,"5min":0.85699999999999998,"15min":1.6180000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26700000000000002},"max":{"1min":0.68300000000000005,"5min":1.141,"15min":1.5940000000000001},"last":0.92400000000000004}]},{"osd":3,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.51900000000000002},"min":{"1min":0.23799999999999999,"5min":0.22500000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":2.2669999999999999,"15min":2.359},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45200000000000001,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55200000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.89700000000000002}]},{"osd":4,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.379,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.216,"15min":0.216},"max":{"1min":0.60499999999999998,"5min":1.1950000000000001,"15min":1.458},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44500000000000001,"15min":0.50600000000000001},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.75800000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.86099999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640347,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2749756,"kb_used_data":2656372,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":91622084,"statfs":{"total":96636764160,"available":93821014016,"internally_reserved":0,"allocated":2720124928,"data_stored":2719999548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.26600000000000001,"15min":0.39500000000000002},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.45400000000000001,"5min":1.026,"15min":2.4620000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.30399999999999999,"15min":0.437},"min":{"1min":0.216,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":1.0369999999999999,"15min":2.5030000000000001},"last":0.65300000000000002}]},{"osd":2,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.27800000000000002,"15min":0.36699999999999999},"min":{"1min":0.20200000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.629},{"interface":"front","average":{"1min":0.318,"5min":0.34799999999999998,"15min":0.38400000000000001},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.71399999999999997,"15min":0.60599999999999998},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":33.82,"15min":33.82},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.69599999999999995,"15min":0.58299999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79100000000000004,"5min":32.356000000000002,"15min":32.356000000000002},"last":0.81699999999999995}]},{"osd":4,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57499999999999996,"5min":0.92500000000000004,"15min":2.8780000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.86499999999999999},"last":0.90700000000000003}]},{"osd":5,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39300000000000002,"15min":5.8540000000000001},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.47399999999999998,"5min":0.63,"15min":143.86699999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.442,"15min":0.56499999999999995},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56200000000000006,"5min":0.98299999999999998,"15min":2.9449999999999998},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2719940608,"data_stored":2719940608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2450526208,"data_stored":2450522136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643057152,"data_stored":1643053080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2676953088,"data_stored":2676949016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2182086656,"data_stored":2182086656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1315962880,"data_stored":1315962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:03:10.746 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.746 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.746 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.747 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.748 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.749 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-09-16T14:55:46.574352+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.749 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:10.749 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T15:03:30.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:03:31.158 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:31.159 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T15:03:31.177 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-16T15:03:30.633871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4329504811,"num_objects":4132,"num_object_clones":0,"num_object_copies":12394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66066,"num_write_kb":4228035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68833,"ondisk_log_size":68833,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":13218788,"kb_used_data":12685172,"kb_used_omap":9,"kb_used_meta":533558,"kb_avail":553012252,"statfs":{"total":579820584960,"available":566284546048,"internally_reserved":0,"allocated":12989616128,"data_stored":12988867940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":546364071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[1,2,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003758"},"pg_stats":[{"pgid":"2.f","version":"21'4743","reported_seq":270666,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:18.549082+0000","last_change":"2024-09-16T15:03:18.549273+0000","last_active":"2024-09-16T15:03:18.549082+0000","last_peered":"2024-09-16T15:03:18.549082+0000","last_clean":"2024-09-16T15:03:18.549082+0000","last_became_active":"2024-09-16T14:55:58.158551+0000","last_became_peered":"2024-09-16T14:55:58.158551+0000","last_unstale":"2024-09-16T15:03:18.549082+0000","last_undegraded":"2024-09-16T15:03:18.549082+0000","last_fullsized":"2024-09-16T15:03:18.549082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4743","last_scrub_stamp":"2024-09-16T15:03:18.549039+0000","last_deep_scrub":"21'4743","last_deep_scrub_stamp":"2024-09-16T15:03:18.549039+0000","last_clean_scrub_stamp":"2024-09-16T15:03:18.549039+0000","objects_scrubbed":279,"log_size":4743,"log_dups_size":0,"ondisk_log_size":4743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:59.186875+0000","scrub_duration":1.4981989470000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292552704,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":265865,"num_read_kb":17015360,"num_write":4464,"num_write_kb":285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"21'4538","reported_seq":259186,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:17.838026+0000","last_change":"2024-09-16T15:03:17.838199+0000","last_active":"2024-09-16T15:03:17.838026+0000","last_peered":"2024-09-16T15:03:17.838026+0000","last_clean":"2024-09-16T15:03:17.838026+0000","last_became_active":"2024-09-16T14:55:58.160822+0000","last_became_peered":"2024-09-16T14:55:58.160822+0000","last_unstale":"2024-09-16T15:03:17.838026+0000","last_undegraded":"2024-09-16T15:03:17.838026+0000","last_fullsized":"2024-09-16T15:03:17.838026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4538","last_scrub_stamp":"2024-09-16T15:03:17.837987+0000","last_deep_scrub":"21'4538","last_deep_scrub_stamp":"2024-09-16T15:03:17.837987+0000","last_clean_scrub_stamp":"2024-09-16T15:03:17.837987+0000","objects_scrubbed":267,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:58:43.383645+0000","scrub_duration":1.515618132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279904256,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":254599,"num_read_kb":16294336,"num_write":4271,"num_write_kb":273344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'4225","reported_seq":290226,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.363926+0000","last_change":"2024-09-16T15:02:58.363926+0000","last_active":"2024-09-16T15:02:58.363926+0000","last_peered":"2024-09-16T15:02:58.363926+0000","last_clean":"2024-09-16T15:02:58.363926+0000","last_became_active":"2024-09-16T14:55:57.741155+0000","last_became_peered":"2024-09-16T14:55:57.741155+0000","last_unstale":"2024-09-16T15:02:58.363926+0000","last_undegraded":"2024-09-16T15:02:58.363926+0000","last_fullsized":"2024-09-16T15:02:58.363926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4225,"log_dups_size":0,"ondisk_log_size":4225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824088,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":251676,"num_read_kb":16107201,"num_write":4225,"num_write_kb":270337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4931,"num_bytes_recovered":5170528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4931},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"21'4063","reported_seq":231902,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:18.444864+0000","last_change":"2024-09-16T15:03:18.445004+0000","last_active":"2024-09-16T15:03:18.444864+0000","last_peered":"2024-09-16T15:03:18.444864+0000","last_clean":"2024-09-16T15:03:18.444864+0000","last_became_active":"2024-09-16T14:55:58.167901+0000","last_became_peered":"2024-09-16T14:55:58.167901+0000","last_unstale":"2024-09-16T15:03:18.444864+0000","last_undegraded":"2024-09-16T15:03:18.444864+0000","last_fullsized":"2024-09-16T15:03:18.444864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4063","last_scrub_stamp":"2024-09-16T15:03:18.444840+0000","last_deep_scrub":"21'4063","last_deep_scrub_stamp":"2024-09-16T15:03:18.444840+0000","last_clean_scrub_stamp":"2024-09-16T15:03:18.444840+0000","objects_scrubbed":239,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:10:28.152139+0000","scrub_duration":1.1568520310000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250609664,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":227792,"num_read_kb":14578688,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"21'3689","reported_seq":210538,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:22.643997+0000","last_change":"2024-09-16T15:03:22.644204+0000","last_active":"2024-09-16T15:03:22.643997+0000","last_peered":"2024-09-16T15:03:22.643997+0000","last_clean":"2024-09-16T15:03:22.643997+0000","last_became_active":"2024-09-16T14:55:57.741678+0000","last_became_peered":"2024-09-16T14:55:57.741678+0000","last_unstale":"2024-09-16T15:03:22.643997+0000","last_undegraded":"2024-09-16T15:03:22.643997+0000","last_fullsized":"2024-09-16T15:03:22.643997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3689","last_scrub_stamp":"2024-09-16T15:03:22.643969+0000","last_deep_scrub":"21'3689","last_deep_scrub_stamp":"2024-09-16T15:03:22.643969+0000","last_clean_scrub_stamp":"2024-09-16T15:03:22.643969+0000","objects_scrubbed":217,"log_size":3689,"log_dups_size":0,"ondisk_log_size":3689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:49:19.297410+0000","scrub_duration":1.0116918509999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":206804,"num_read_kb":13235456,"num_write":3472,"num_write_kb":222208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'4016","reported_seq":276055,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.358277+0000","last_change":"2024-09-16T15:02:58.358277+0000","last_active":"2024-09-16T15:02:58.358277+0000","last_peered":"2024-09-16T15:02:58.358277+0000","last_clean":"2024-09-16T15:02:58.358277+0000","last_became_active":"2024-09-16T14:55:57.741046+0000","last_became_peered":"2024-09-16T14:55:57.741046+0000","last_unstale":"2024-09-16T15:02:58.358277+0000","last_undegraded":"2024-09-16T15:02:58.358277+0000","last_fullsized":"2024-09-16T15:02:58.358277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":238837,"num_read_kb":15285568,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4759,"num_bytes_recovered":4990173184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4759},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"21'4160","reported_seq":286045,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.353931+0000","last_change":"2024-09-16T15:02:58.206062+0000","last_active":"2024-09-16T15:02:58.353931+0000","last_peered":"2024-09-16T15:02:58.353931+0000","last_clean":"2024-09-16T15:02:58.353931+0000","last_became_active":"2024-09-16T14:55:58.164678+0000","last_became_peered":"2024-09-16T14:55:58.164678+0000","last_unstale":"2024-09-16T15:02:58.353931+0000","last_undegraded":"2024-09-16T15:02:58.353931+0000","last_fullsized":"2024-09-16T15:02:58.353931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":247262,"num_read_kb":15824768,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4971,"num_bytes_recovered":5212471296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4971},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"21'3952","reported_seq":239215,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356120+0000","last_change":"2024-09-16T14:55:58.165301+0000","last_active":"2024-09-16T15:02:58.356120+0000","last_peered":"2024-09-16T15:02:58.356120+0000","last_clean":"2024-09-16T15:02:58.356120+0000","last_became_active":"2024-09-16T14:55:58.164424+0000","last_became_peered":"2024-09-16T14:55:58.164424+0000","last_unstale":"2024-09-16T15:02:58.356120+0000","last_undegraded":"2024-09-16T15:02:58.356120+0000","last_fullsized":"2024-09-16T15:02:58.356120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":3952,"log_dups_size":0,"ondisk_log_size":3952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":235245,"num_read_kb":15055680,"num_write":3952,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:10.706879+0000","last_change":"2024-09-16T15:03:10.707106+0000","last_active":"2024-09-16T15:03:10.706879+0000","last_peered":"2024-09-16T15:03:10.706879+0000","last_clean":"2024-09-16T15:03:10.706879+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T15:03:10.706879+0000","last_undegraded":"2024-09-16T15:03:10.706879+0000","last_fullsized":"2024-09-16T15:03:10.706879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:10.706826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:10.706826+0000","last_clean_scrub_stamp":"2024-09-16T15:03:10.706826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:09:27.981166+0000","scrub_duration":0.0030641449999999999,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"21'4437","reported_seq":253163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:24.534258+0000","last_change":"2024-09-16T15:03:24.534487+0000","last_active":"2024-09-16T15:03:24.534258+0000","last_peered":"2024-09-16T15:03:24.534258+0000","last_clean":"2024-09-16T15:03:24.534258+0000","last_became_active":"2024-09-16T14:55:57.735457+0000","last_became_peered":"2024-09-16T14:55:57.735457+0000","last_unstale":"2024-09-16T15:03:24.534258+0000","last_undegraded":"2024-09-16T15:03:24.534258+0000","last_fullsized":"2024-09-16T15:03:24.534258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4437","last_scrub_stamp":"2024-09-16T15:03:24.534203+0000","last_deep_scrub":"21'4437","last_deep_scrub_stamp":"2024-09-16T15:03:24.534203+0000","last_clean_scrub_stamp":"2024-09-16T15:03:24.534203+0000","objects_scrubbed":261,"log_size":4437,"log_dups_size":0,"ondisk_log_size":4437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:43:49.333546+0000","scrub_duration":1.3523638010000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":248677,"num_read_kb":15915328,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:16.157753+0000","last_change":"2024-09-16T15:03:16.157956+0000","last_active":"2024-09-16T15:03:16.157753+0000","last_peered":"2024-09-16T15:03:16.157753+0000","last_clean":"2024-09-16T15:03:16.157753+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T15:03:16.157753+0000","last_undegraded":"2024-09-16T15:03:16.157753+0000","last_fullsized":"2024-09-16T15:03:16.157753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:16.157708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:16.157708+0000","last_clean_scrub_stamp":"2024-09-16T15:03:16.157708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:20:05.390922+0000","scrub_duration":0.0030618220000000001,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'4267","reported_seq":243499,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:23.613331+0000","last_change":"2024-09-16T15:03:23.613501+0000","last_active":"2024-09-16T15:03:23.613331+0000","last_peered":"2024-09-16T15:03:23.613331+0000","last_clean":"2024-09-16T15:03:23.613331+0000","last_became_active":"2024-09-16T14:55:58.160928+0000","last_became_peered":"2024-09-16T14:55:58.160928+0000","last_unstale":"2024-09-16T15:03:23.613331+0000","last_undegraded":"2024-09-16T15:03:23.613331+0000","last_fullsized":"2024-09-16T15:03:23.613331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4267","last_scrub_stamp":"2024-09-16T15:03:23.613289+0000","last_deep_scrub":"21'4267","last_deep_scrub_stamp":"2024-09-16T15:03:23.613289+0000","last_clean_scrub_stamp":"2024-09-16T15:03:23.613289+0000","objects_scrubbed":251,"log_size":4267,"log_dups_size":0,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:45:07.656672+0000","scrub_duration":1.481871757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":239183,"num_read_kb":15307712,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"21'3","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:14.015640+0000","last_change":"2024-09-16T15:03:14.015890+0000","last_active":"2024-09-16T15:03:14.015640+0000","last_peered":"2024-09-16T15:03:14.015640+0000","last_clean":"2024-09-16T15:03:14.015640+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T15:03:14.015640+0000","last_undegraded":"2024-09-16T15:03:14.015640+0000","last_fullsized":"2024-09-16T15:03:14.015640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2024-09-16T15:03:14.015584+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2024-09-16T15:03:14.015584+0000","last_clean_scrub_stamp":"2024-09-16T15:03:14.015584+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:29:45.183939+0000","scrub_duration":0.0070946150000000003,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"21'4403","reported_seq":251000,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:10.381301+0000","last_change":"2024-09-16T15:03:10.381452+0000","last_active":"2024-09-16T15:03:10.381301+0000","last_peered":"2024-09-16T15:03:10.381301+0000","last_clean":"2024-09-16T15:03:10.381301+0000","last_became_active":"2024-09-16T14:55:58.160444+0000","last_became_peered":"2024-09-16T14:55:58.160444+0000","last_unstale":"2024-09-16T15:03:10.381301+0000","last_undegraded":"2024-09-16T15:03:10.381301+0000","last_fullsized":"2024-09-16T15:03:10.381301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4403","last_scrub_stamp":"2024-09-16T15:03:10.381261+0000","last_deep_scrub":"21'4403","last_deep_scrub_stamp":"2024-09-16T15:03:10.381261+0000","last_clean_scrub_stamp":"2024-09-16T15:03:10.381261+0000","objects_scrubbed":259,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:51.646361+0000","scrub_duration":1.0113366029999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":246548,"num_read_kb":15779072,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"21'2","reported_seq":36,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:19.379946+0000","last_change":"2024-09-16T15:03:19.380118+0000","last_active":"2024-09-16T15:03:19.379946+0000","last_peered":"2024-09-16T15:03:19.379946+0000","last_clean":"2024-09-16T15:03:19.379946+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T15:03:19.379946+0000","last_undegraded":"2024-09-16T15:03:19.379946+0000","last_fullsized":"2024-09-16T15:03:19.379946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2024-09-16T15:03:19.379893+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2024-09-16T15:03:19.379893+0000","last_clean_scrub_stamp":"2024-09-16T15:03:19.379893+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:21:53.617156+0000","scrub_duration":0.0061412530000000002,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"21'4420","reported_seq":252658,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:20.118703+0000","last_change":"2024-09-16T15:03:20.118943+0000","last_active":"2024-09-16T15:03:20.118703+0000","last_peered":"2024-09-16T15:03:20.118703+0000","last_clean":"2024-09-16T15:03:20.118703+0000","last_became_active":"2024-09-16T14:55:58.164104+0000","last_became_peered":"2024-09-16T14:55:58.164104+0000","last_unstale":"2024-09-16T15:03:20.118703+0000","last_undegraded":"2024-09-16T15:03:20.118703+0000","last_fullsized":"2024-09-16T15:03:20.118703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4420","last_scrub_stamp":"2024-09-16T15:03:20.118647+0000","last_deep_scrub":"21'4420","last_deep_scrub_stamp":"2024-09-16T15:03:20.118647+0000","last_clean_scrub_stamp":"2024-09-16T15:03:20.118647+0000","objects_scrubbed":260,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:16.434746+0000","scrub_duration":1.456719439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":248189,"num_read_kb":15884096,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4631","reported_seq":268349,"reported_epoch":21,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-16T15:03:25.718698+0000","last_change":"2024-09-16T15:03:24.625450+0000","last_active":"2024-09-16T15:03:25.718698+0000","last_peered":"2024-09-16T15:03:25.718698+0000","last_clean":"2024-09-16T15:03:25.718698+0000","last_became_active":"2024-09-16T14:55:57.740121+0000","last_became_peered":"2024-09-16T14:55:57.740121+0000","last_unstale":"2024-09-16T15:03:25.718698+0000","last_undegraded":"2024-09-16T15:03:25.718698+0000","last_fullsized":"2024-09-16T15:03:25.718698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":199,"log_size":4631,"log_dups_size":0,"ondisk_log_size":4631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":263679,"num_read_kb":16875456,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:21.436279+0000","last_change":"2024-09-16T15:03:21.436509+0000","last_active":"2024-09-16T15:03:21.436279+0000","last_peered":"2024-09-16T15:03:21.436279+0000","last_clean":"2024-09-16T15:03:21.436279+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T15:03:21.436279+0000","last_undegraded":"2024-09-16T15:03:21.436279+0000","last_fullsized":"2024-09-16T15:03:21.436279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:21.436231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:21.436231+0000","last_clean_scrub_stamp":"2024-09-16T15:03:21.436231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:10:37.109898+0000","scrub_duration":0.0032458650000000001,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'4240","reported_seq":291413,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:02:58.356701+0000","last_change":"2024-09-16T15:02:58.315413+0000","last_active":"2024-09-16T15:02:58.356701+0000","last_peered":"2024-09-16T15:02:58.356701+0000","last_clean":"2024-09-16T15:02:58.356701+0000","last_became_active":"2024-09-16T14:55:57.737731+0000","last_became_peered":"2024-09-16T14:55:57.737731+0000","last_unstale":"2024-09-16T15:02:58.356701+0000","last_undegraded":"2024-09-16T15:02:58.356701+0000","last_fullsized":"2024-09-16T15:02:58.356701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:55:55.609939+0000","last_clean_scrub_stamp":"2024-09-16T14:55:55.609939+0000","objects_scrubbed":0,"log_size":4240,"log_dups_size":0,"ondisk_log_size":4240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":252293,"num_read_kb":16146752,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5005,"num_bytes_recovered":5248122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5005},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:11.058649+0000","last_change":"2024-09-16T15:03:11.058853+0000","last_active":"2024-09-16T15:03:11.058649+0000","last_peered":"2024-09-16T15:03:11.058649+0000","last_clean":"2024-09-16T15:03:11.058649+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T15:03:11.058649+0000","last_undegraded":"2024-09-16T15:03:11.058649+0000","last_fullsized":"2024-09-16T15:03:11.058649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:11.058600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:11.058600+0000","last_clean_scrub_stamp":"2024-09-16T15:03:11.058600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:50:48.961709+0000","scrub_duration":0.0031610509999999998,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"21'4522","reported_seq":257831,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:24.107470+0000","last_change":"2024-09-16T15:03:24.107669+0000","last_active":"2024-09-16T15:03:24.107470+0000","last_peered":"2024-09-16T15:03:24.107470+0000","last_clean":"2024-09-16T15:03:24.107470+0000","last_became_active":"2024-09-16T14:55:58.160681+0000","last_became_peered":"2024-09-16T14:55:58.160681+0000","last_unstale":"2024-09-16T15:03:24.107470+0000","last_undegraded":"2024-09-16T15:03:24.107470+0000","last_fullsized":"2024-09-16T15:03:24.107470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4522","last_scrub_stamp":"2024-09-16T15:03:24.107431+0000","last_deep_scrub":"21'4522","last_deep_scrub_stamp":"2024-09-16T15:03:24.107431+0000","last_clean_scrub_stamp":"2024-09-16T15:03:24.107431+0000","objects_scrubbed":266,"log_size":4522,"log_dups_size":0,"ondisk_log_size":4522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:39:08.974970+0000","scrub_duration":1.451546985,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253260,"num_read_kb":16208640,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:16.726878+0000","last_change":"2024-09-16T15:03:16.727073+0000","last_active":"2024-09-16T15:03:16.726878+0000","last_peered":"2024-09-16T15:03:16.726878+0000","last_clean":"2024-09-16T15:03:16.726878+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T15:03:16.726878+0000","last_undegraded":"2024-09-16T15:03:16.726878+0000","last_fullsized":"2024-09-16T15:03:16.726878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:16.726830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:16.726830+0000","last_clean_scrub_stamp":"2024-09-16T15:03:16.726830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:53:24.386278+0000","scrub_duration":0.039050964000000001,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:21.161283+0000","last_change":"2024-09-16T15:03:21.161493+0000","last_active":"2024-09-16T15:03:21.161283+0000","last_peered":"2024-09-16T15:03:21.161283+0000","last_clean":"2024-09-16T15:03:21.161283+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T15:03:21.161283+0000","last_undegraded":"2024-09-16T15:03:21.161283+0000","last_fullsized":"2024-09-16T15:03:21.161283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:21.161225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:21.161225+0000","last_clean_scrub_stamp":"2024-09-16T15:03:21.161225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:15.717423+0000","scrub_duration":0.0030878289999999998,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"21'4522","reported_seq":292088,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:23.962994+0000","last_change":"2024-09-16T15:03:23.963128+0000","last_active":"2024-09-16T15:03:23.962994+0000","last_peered":"2024-09-16T15:03:23.962994+0000","last_clean":"2024-09-16T15:03:23.962994+0000","last_became_active":"2024-09-16T14:55:58.164766+0000","last_became_peered":"2024-09-16T14:55:58.164766+0000","last_unstale":"2024-09-16T15:03:23.962994+0000","last_undegraded":"2024-09-16T15:03:23.962994+0000","last_fullsized":"2024-09-16T15:03:23.962994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4522","last_scrub_stamp":"2024-09-16T15:03:23.962974+0000","last_deep_scrub":"21'4522","last_deep_scrub_stamp":"2024-09-16T15:03:23.962974+0000","last_clean_scrub_stamp":"2024-09-16T15:03:23.962974+0000","objects_scrubbed":266,"log_size":4522,"log_dups_size":0,"ondisk_log_size":4522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:06.956397+0000","scrub_duration":1.5390856610000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253030,"num_read_kb":16193920,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4949,"num_bytes_recovered":5189402624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4949},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4329504792,"num_objects":4130,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66064,"num_write_kb":4228033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12988526592,"data_stored":12988514376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68828,"ondisk_log_size":68828,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640350,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2202428,"kb_used_data":2131124,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":92169412,"statfs":{"total":96636764160,"available":94381477888,"internally_reserved":0,"allocated":2182270976,"data_stored":2182145596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73005510},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.44400000000000001},"min":{"1min":0.23000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.498,"5min":0.70199999999999996,"15min":1.6399999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.48999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.75900000000000001,"15min":1.4039999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.73299999999999998,"5min":0.97599999999999998,"15min":1.079},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.44500000000000001},"min":{"1min":0.24099999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.45900000000000002,"5min":1.0529999999999999,"15min":1.1819999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.52700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.58399999999999996,"5min":1.681,"15min":1.681},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66200000000000003,"5min":0.94499999999999995,"15min":1.1020000000000001},"last":0.93999999999999995}]},{"osd":3,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.76200000000000001,"15min":1.274},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.378,"5min":0.375,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56299999999999994,"5min":0.90000000000000002,"15min":1.5249999999999999},"last":1.038}]},{"osd":5,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.378,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":1.0109999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.504},"min":{"1min":0.27000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55000000000000004,"5min":0.74199999999999999,"15min":1.347},"last":0.76600000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640351,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2689788,"kb_used_data":2614388,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":91682052,"statfs":{"total":96636764160,"available":93882421248,"internally_reserved":0,"allocated":2677133312,"data_stored":2677007937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":77199816},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.45800000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":2.1309999999999998},"last":0.75},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.47999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":0.88100000000000001,"5min":1.377,"15min":1.377},"last":0.64600000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40699999999999997,"15min":0.53900000000000003},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.85099999999999998,"5min":1.587,"15min":1.8540000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38800000000000001,"15min":0.52700000000000002},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.80200000000000005,"5min":1.1919999999999999,"15min":2.504},"last":0.66000000000000003}]},{"osd":2,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":1.8080000000000001},"last":0.622},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":2.3679999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.46000000000000002},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.71899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.51000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":1.883},"last":0.68899999999999995}]},{"osd":5,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.60599999999999998},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.68000000000000005,"5min":0.996,"15min":3.968},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.82899999999999996,"5min":1.359,"15min":1.359},"last":0.443}]}]},{"osd":2,"up_from":11,"seq":47244640350,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1649788,"kb_used_data":1604724,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92722052,"statfs":{"total":96636764160,"available":94947381248,"internally_reserved":0,"allocated":1643237376,"data_stored":1643112001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26200000000000001,"15min":0.33500000000000002},"min":{"1min":0.17799999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42299999999999999,"5min":0.79400000000000004,"15min":1.222},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36699999999999999,"15min":0.42799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.64700000000000002,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.86799999999999999,"15min":0.57199999999999995},"min":{"1min":0.19500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71099999999999997,"5min":53.473999999999997,"15min":53.473999999999997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.81100000000000005,"15min":0.58799999999999997},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":0.51800000000000002,"5min":53.326000000000001,"15min":53.326000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.47599999999999998},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1950000000000001},"last":0.877},{"interface":"front","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.26200000000000001},"max":{"1min":0.72999999999999998,"5min":1.839,"15min":1.839},"last":0.82899999999999996}]},{"osd":4,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":1.8380000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61899999999999999,"5min":0.65900000000000003,"15min":0.92900000000000005},"last":0.80400000000000005}]},{"osd":5,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.016,"15min":0.70899999999999996},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":58.322000000000003,"15min":58.322000000000003},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.91900000000000004,"15min":0.70999999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":58.619,"15min":58.619},"last":0.84199999999999997}]}]},{"osd":1,"up_from":11,"seq":47244640350,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2600764,"kb_used_data":2393268,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":91771076,"statfs":{"total":96636764160,"available":93973581824,"internally_reserved":0,"allocated":2450706432,"data_stored":2450581057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[1,2,1,1,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.253,"15min":0.29599999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.41099999999999998,"5min":0.60199999999999998,"15min":0.72499999999999998},"last":0.442},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.307,"15min":0.33500000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16400000000000001},"max":{"1min":0.54800000000000004,"5min":0.61099999999999999,"15min":0.77500000000000002},"last":0.85999999999999999}]},{"osd":2,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.26200000000000001,"15min":0.34100000000000003},"min":{"1min":0.182,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.51900000000000002,"5min":0.64900000000000002,"15min":0.73299999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.33000000000000002,"15min":0.375},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.60299999999999998,"15min":0.88400000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.748,"15min":0.60899999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61299999999999999,"5min":30.193000000000001,"15min":30.193000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.69999999999999996,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":30.173999999999999,"15min":30.173999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38300000000000001,"15min":0.45600000000000002},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.68500000000000005,"15min":1.0860000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45500000000000002,"15min":0.51700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57199999999999995,"5min":0.89800000000000002,"15min":1.325},"last":0.56899999999999995}]},{"osd":5,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40600000000000003,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.59199999999999997,"5min":0.98299999999999998,"15min":1.036},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.438,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.48699999999999999,"5min":0.97199999999999998,"15min":1.2829999999999999},"last":0.75900000000000001}]}]},{"osd":5,"up_from":11,"seq":47244640351,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1338552,"kb_used_data":1285296,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":93033288,"statfs":{"total":96636764160,"available":95266086912,"internally_reserved":0,"allocated":1316143104,"data_stored":1316021801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54524359},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.377,"15min":0.45800000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.89000000000000001,"5min":2.286,"15min":2.286},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.51100000000000001},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.78800000000000003,"5min":1.103,"15min":1.536},"last":0.70499999999999996}]},{"osd":1,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":1.3500000000000001,"15min":0.79700000000000004},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.74299999999999999,"5min":79.933999999999997,"15min":79.933999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":1.327,"15min":0.77700000000000002},"min":{"1min":0.246,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71099999999999997,"5min":79.793999999999997,"15min":79.793999999999997},"last":0.81100000000000005}]},{"osd":2,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.82699999999999996,"5min":0.85699999999999998,"15min":1.6180000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26700000000000002},"max":{"1min":0.68300000000000005,"5min":1.141,"15min":1.5940000000000001},"last":0.83599999999999997}]},{"osd":3,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.51900000000000002},"min":{"1min":0.23799999999999999,"5min":0.22500000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":2.2669999999999999,"15min":2.359},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45200000000000001,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55200000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.379,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.216,"15min":0.216},"max":{"1min":0.60499999999999998,"5min":1.1950000000000001,"15min":1.458},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44500000000000001,"15min":0.50600000000000001},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.75800000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.78100000000000003}]}]},{"osd":0,"up_from":11,"seq":47244640351,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2737468,"kb_used_data":2656372,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":91634372,"statfs":{"total":96636764160,"available":93833596928,"internally_reserved":0,"allocated":2720124928,"data_stored":2719999548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.26600000000000001,"15min":0.39500000000000002},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.45400000000000001,"5min":1.026,"15min":2.4620000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.30399999999999999,"15min":0.437},"min":{"1min":0.216,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":1.0369999999999999,"15min":2.5030000000000001},"last":0.73299999999999998}]},{"osd":2,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.27800000000000002,"15min":0.36699999999999999},"min":{"1min":0.20200000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.318,"5min":0.34799999999999998,"15min":0.38400000000000001},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57299999999999995}]},{"osd":3,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.71399999999999997,"15min":0.60599999999999998},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":33.82,"15min":33.82},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.69599999999999995,"15min":0.58299999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79100000000000004,"5min":32.356000000000002,"15min":32.356000000000002},"last":0.65000000000000002}]},{"osd":4,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57499999999999996,"5min":0.92500000000000004,"15min":2.8780000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.86499999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39300000000000002,"15min":5.8540000000000001},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.47399999999999998,"5min":0.63,"15min":143.86699999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.442,"15min":0.56499999999999995},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56200000000000006,"5min":0.98299999999999998,"15min":2.9449999999999998},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2719940608,"data_stored":2719940608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2450526208,"data_stored":2450522136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643057152,"data_stored":1643053080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2676953088,"data_stored":2676949016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2182086656,"data_stored":2182086656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1315962880,"data_stored":1315962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:03:31.179 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:31.180 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:31.180 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:31.180 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:31.180 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:31.180 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T14:55:55.609939+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=55, tm_sec=55, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=15, tm_min=3, tm_sec=6, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T15:03:31.180 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T15:03:51.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T15:03:51.828 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-16T15:03:51.829 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-16T15:03:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2024-09-16T15:03:50.639715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4329504811,"num_objects":4132,"num_object_clones":0,"num_object_copies":12394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4132,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66066,"num_write_kb":4228035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70199,"ondisk_log_size":70199,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":13214692,"kb_used_data":12685172,"kb_used_omap":9,"kb_used_meta":529462,"kb_avail":553016348,"statfs":{"total":579820584960,"available":566288740352,"internally_reserved":0,"allocated":12989616128,"data_stored":12988867940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":542169767},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"2.f","version":"21'4743","reported_seq":270666,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:18.549082+0000","last_change":"2024-09-16T15:03:18.549273+0000","last_active":"2024-09-16T15:03:18.549082+0000","last_peered":"2024-09-16T15:03:18.549082+0000","last_clean":"2024-09-16T15:03:18.549082+0000","last_became_active":"2024-09-16T14:55:58.158551+0000","last_became_peered":"2024-09-16T14:55:58.158551+0000","last_unstale":"2024-09-16T15:03:18.549082+0000","last_undegraded":"2024-09-16T15:03:18.549082+0000","last_fullsized":"2024-09-16T15:03:18.549082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4743","last_scrub_stamp":"2024-09-16T15:03:18.549039+0000","last_deep_scrub":"21'4743","last_deep_scrub_stamp":"2024-09-16T15:03:18.549039+0000","last_clean_scrub_stamp":"2024-09-16T15:03:18.549039+0000","objects_scrubbed":279,"log_size":4743,"log_dups_size":0,"ondisk_log_size":4743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:59:59.186875+0000","scrub_duration":1.4981989470000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292552704,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":279,"num_whiteouts":0,"num_read":265865,"num_read_kb":17015360,"num_write":4464,"num_write_kb":285696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"21'4538","reported_seq":259186,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:17.838026+0000","last_change":"2024-09-16T15:03:17.838199+0000","last_active":"2024-09-16T15:03:17.838026+0000","last_peered":"2024-09-16T15:03:17.838026+0000","last_clean":"2024-09-16T15:03:17.838026+0000","last_became_active":"2024-09-16T14:55:58.160822+0000","last_became_peered":"2024-09-16T14:55:58.160822+0000","last_unstale":"2024-09-16T15:03:17.838026+0000","last_undegraded":"2024-09-16T15:03:17.838026+0000","last_fullsized":"2024-09-16T15:03:17.838026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4538","last_scrub_stamp":"2024-09-16T15:03:17.837987+0000","last_deep_scrub":"21'4538","last_deep_scrub_stamp":"2024-09-16T15:03:17.837987+0000","last_clean_scrub_stamp":"2024-09-16T15:03:17.837987+0000","objects_scrubbed":267,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:58:43.383645+0000","scrub_duration":1.515618132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279904256,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":254599,"num_read_kb":16294336,"num_write":4271,"num_write_kb":273344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'4490","reported_seq":290522,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:29.825831+0000","last_change":"2024-09-16T15:03:29.826014+0000","last_active":"2024-09-16T15:03:29.825831+0000","last_peered":"2024-09-16T15:03:29.825831+0000","last_clean":"2024-09-16T15:03:29.825831+0000","last_became_active":"2024-09-16T14:55:57.741155+0000","last_became_peered":"2024-09-16T14:55:57.741155+0000","last_unstale":"2024-09-16T15:03:29.825831+0000","last_undegraded":"2024-09-16T15:03:29.825831+0000","last_fullsized":"2024-09-16T15:03:29.825831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4490","last_scrub_stamp":"2024-09-16T15:03:29.825805+0000","last_deep_scrub":"21'4490","last_deep_scrub_stamp":"2024-09-16T15:03:29.825805+0000","last_clean_scrub_stamp":"2024-09-16T15:03:29.825805+0000","objects_scrubbed":265,"log_size":4490,"log_dups_size":0,"ondisk_log_size":4490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:25.959910+0000","scrub_duration":1.312086627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824088,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":251676,"num_read_kb":16107201,"num_write":4225,"num_write_kb":270337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4931,"num_bytes_recovered":5170528256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4931},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"21'4063","reported_seq":231902,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:18.444864+0000","last_change":"2024-09-16T15:03:18.445004+0000","last_active":"2024-09-16T15:03:18.444864+0000","last_peered":"2024-09-16T15:03:18.444864+0000","last_clean":"2024-09-16T15:03:18.444864+0000","last_became_active":"2024-09-16T14:55:58.167901+0000","last_became_peered":"2024-09-16T14:55:58.167901+0000","last_unstale":"2024-09-16T15:03:18.444864+0000","last_undegraded":"2024-09-16T15:03:18.444864+0000","last_fullsized":"2024-09-16T15:03:18.444864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4063","last_scrub_stamp":"2024-09-16T15:03:18.444840+0000","last_deep_scrub":"21'4063","last_deep_scrub_stamp":"2024-09-16T15:03:18.444840+0000","last_clean_scrub_stamp":"2024-09-16T15:03:18.444840+0000","objects_scrubbed":239,"log_size":4063,"log_dups_size":0,"ondisk_log_size":4063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:10:28.152139+0000","scrub_duration":1.1568520310000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250609664,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":227792,"num_read_kb":14578688,"num_write":3824,"num_write_kb":244736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"21'3689","reported_seq":210538,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:22.643997+0000","last_change":"2024-09-16T15:03:22.644204+0000","last_active":"2024-09-16T15:03:22.643997+0000","last_peered":"2024-09-16T15:03:22.643997+0000","last_clean":"2024-09-16T15:03:22.643997+0000","last_became_active":"2024-09-16T14:55:57.741678+0000","last_became_peered":"2024-09-16T14:55:57.741678+0000","last_unstale":"2024-09-16T15:03:22.643997+0000","last_undegraded":"2024-09-16T15:03:22.643997+0000","last_fullsized":"2024-09-16T15:03:22.643997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3689","last_scrub_stamp":"2024-09-16T15:03:22.643969+0000","last_deep_scrub":"21'3689","last_deep_scrub_stamp":"2024-09-16T15:03:22.643969+0000","last_clean_scrub_stamp":"2024-09-16T15:03:22.643969+0000","objects_scrubbed":217,"log_size":3689,"log_dups_size":0,"ondisk_log_size":3689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:49:19.297410+0000","scrub_duration":1.0116918509999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227540992,"num_objects":217,"num_object_clones":0,"num_object_copies":651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":217,"num_whiteouts":0,"num_read":206804,"num_read_kb":13235456,"num_write":3472,"num_write_kb":222208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"21'4267","reported_seq":276337,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:28.892926+0000","last_change":"2024-09-16T15:03:28.893035+0000","last_active":"2024-09-16T15:03:28.892926+0000","last_peered":"2024-09-16T15:03:28.892926+0000","last_clean":"2024-09-16T15:03:28.892926+0000","last_became_active":"2024-09-16T14:55:57.741046+0000","last_became_peered":"2024-09-16T14:55:57.741046+0000","last_unstale":"2024-09-16T15:03:28.892926+0000","last_undegraded":"2024-09-16T15:03:28.892926+0000","last_fullsized":"2024-09-16T15:03:28.892926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4267","last_scrub_stamp":"2024-09-16T15:03:28.892903+0000","last_deep_scrub":"21'4267","last_deep_scrub_stamp":"2024-09-16T15:03:28.892903+0000","last_clean_scrub_stamp":"2024-09-16T15:03:28.892903+0000","objects_scrubbed":251,"log_size":4267,"log_dups_size":0,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:29:37.648974+0000","scrub_duration":1.363924371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":238837,"num_read_kb":15285568,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4759,"num_bytes_recovered":4990173184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4759},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"21'4420","reported_seq":286336,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:33.802776+0000","last_change":"2024-09-16T15:03:33.802926+0000","last_active":"2024-09-16T15:03:33.802776+0000","last_peered":"2024-09-16T15:03:33.802776+0000","last_clean":"2024-09-16T15:03:33.802776+0000","last_became_active":"2024-09-16T14:55:58.164678+0000","last_became_peered":"2024-09-16T14:55:58.164678+0000","last_unstale":"2024-09-16T15:03:33.802776+0000","last_undegraded":"2024-09-16T15:03:33.802776+0000","last_fullsized":"2024-09-16T15:03:33.802776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4420","last_scrub_stamp":"2024-09-16T15:03:33.802743+0000","last_deep_scrub":"21'4420","last_deep_scrub_stamp":"2024-09-16T15:03:33.802743+0000","last_clean_scrub_stamp":"2024-09-16T15:03:33.802743+0000","objects_scrubbed":260,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:32:44.630795+0000","scrub_duration":1.31658597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":247262,"num_read_kb":15824768,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4971,"num_bytes_recovered":5212471296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4971},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"21'4199","reported_seq":239491,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:29.881041+0000","last_change":"2024-09-16T15:03:29.881223+0000","last_active":"2024-09-16T15:03:29.881041+0000","last_peered":"2024-09-16T15:03:29.881041+0000","last_clean":"2024-09-16T15:03:29.881041+0000","last_became_active":"2024-09-16T14:55:58.164424+0000","last_became_peered":"2024-09-16T14:55:58.164424+0000","last_unstale":"2024-09-16T15:03:29.881041+0000","last_undegraded":"2024-09-16T15:03:29.881041+0000","last_fullsized":"2024-09-16T15:03:29.881041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4199","last_scrub_stamp":"2024-09-16T15:03:29.881018+0000","last_deep_scrub":"21'4199","last_deep_scrub_stamp":"2024-09-16T15:03:29.881018+0000","last_clean_scrub_stamp":"2024-09-16T15:03:29.881018+0000","objects_scrubbed":247,"log_size":4199,"log_dups_size":0,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:45:01.829343+0000","scrub_duration":1.2326420570000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":258998272,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":247,"num_whiteouts":0,"num_read":235245,"num_read_kb":15055680,"num_write":3952,"num_write_kb":252928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:10.706879+0000","last_change":"2024-09-16T15:03:10.707106+0000","last_active":"2024-09-16T15:03:10.706879+0000","last_peered":"2024-09-16T15:03:10.706879+0000","last_clean":"2024-09-16T15:03:10.706879+0000","last_became_active":"2024-09-16T14:55:48.061479+0000","last_became_peered":"2024-09-16T14:55:48.061479+0000","last_unstale":"2024-09-16T15:03:10.706879+0000","last_undegraded":"2024-09-16T15:03:10.706879+0000","last_fullsized":"2024-09-16T15:03:10.706879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:10.706826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:10.706826+0000","last_clean_scrub_stamp":"2024-09-16T15:03:10.706826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:09:27.981166+0000","scrub_duration":0.0030641449999999999,"objects_trimmed":0,"snaptrim_duration":0.000960756,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"21'4437","reported_seq":253163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:24.534258+0000","last_change":"2024-09-16T15:03:24.534487+0000","last_active":"2024-09-16T15:03:24.534258+0000","last_peered":"2024-09-16T15:03:24.534258+0000","last_clean":"2024-09-16T15:03:24.534258+0000","last_became_active":"2024-09-16T14:55:57.735457+0000","last_became_peered":"2024-09-16T14:55:57.735457+0000","last_unstale":"2024-09-16T15:03:24.534258+0000","last_undegraded":"2024-09-16T15:03:24.534258+0000","last_fullsized":"2024-09-16T15:03:24.534258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4437","last_scrub_stamp":"2024-09-16T15:03:24.534203+0000","last_deep_scrub":"21'4437","last_deep_scrub_stamp":"2024-09-16T15:03:24.534203+0000","last_clean_scrub_stamp":"2024-09-16T15:03:24.534203+0000","objects_scrubbed":261,"log_size":4437,"log_dups_size":0,"ondisk_log_size":4437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:43:49.333546+0000","scrub_duration":1.3523638010000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":273678336,"num_objects":261,"num_object_clones":0,"num_object_copies":783,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":261,"num_whiteouts":0,"num_read":248677,"num_read_kb":15915328,"num_write":4176,"num_write_kb":267264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:16.157753+0000","last_change":"2024-09-16T15:03:16.157956+0000","last_active":"2024-09-16T15:03:16.157753+0000","last_peered":"2024-09-16T15:03:16.157753+0000","last_clean":"2024-09-16T15:03:16.157753+0000","last_became_active":"2024-09-16T14:55:48.060886+0000","last_became_peered":"2024-09-16T14:55:48.060886+0000","last_unstale":"2024-09-16T15:03:16.157753+0000","last_undegraded":"2024-09-16T15:03:16.157753+0000","last_fullsized":"2024-09-16T15:03:16.157753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:16.157708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:16.157708+0000","last_clean_scrub_stamp":"2024-09-16T15:03:16.157708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:20:05.390922+0000","scrub_duration":0.0030618220000000001,"objects_trimmed":0,"snaptrim_duration":0.00070656099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"21'4267","reported_seq":243499,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:23.613331+0000","last_change":"2024-09-16T15:03:23.613501+0000","last_active":"2024-09-16T15:03:23.613331+0000","last_peered":"2024-09-16T15:03:23.613331+0000","last_clean":"2024-09-16T15:03:23.613331+0000","last_became_active":"2024-09-16T14:55:58.160928+0000","last_became_peered":"2024-09-16T14:55:58.160928+0000","last_unstale":"2024-09-16T15:03:23.613331+0000","last_undegraded":"2024-09-16T15:03:23.613331+0000","last_fullsized":"2024-09-16T15:03:23.613331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4267","last_scrub_stamp":"2024-09-16T15:03:23.613289+0000","last_deep_scrub":"21'4267","last_deep_scrub_stamp":"2024-09-16T15:03:23.613289+0000","last_clean_scrub_stamp":"2024-09-16T15:03:23.613289+0000","objects_scrubbed":251,"log_size":4267,"log_dups_size":0,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:45:07.656672+0000","scrub_duration":1.481871757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":239183,"num_read_kb":15307712,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"21'3","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:14.015640+0000","last_change":"2024-09-16T15:03:14.015890+0000","last_active":"2024-09-16T15:03:14.015640+0000","last_peered":"2024-09-16T15:03:14.015640+0000","last_clean":"2024-09-16T15:03:14.015640+0000","last_became_active":"2024-09-16T14:55:48.060666+0000","last_became_peered":"2024-09-16T14:55:48.060666+0000","last_unstale":"2024-09-16T15:03:14.015640+0000","last_undegraded":"2024-09-16T15:03:14.015640+0000","last_fullsized":"2024-09-16T15:03:14.015640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'3","last_scrub_stamp":"2024-09-16T15:03:14.015584+0000","last_deep_scrub":"21'3","last_deep_scrub_stamp":"2024-09-16T15:03:14.015584+0000","last_clean_scrub_stamp":"2024-09-16T15:03:14.015584+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:29:45.183939+0000","scrub_duration":0.0070946150000000003,"objects_trimmed":0,"snaptrim_duration":0.0020552309999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"21'4403","reported_seq":251000,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:10.381301+0000","last_change":"2024-09-16T15:03:10.381452+0000","last_active":"2024-09-16T15:03:10.381301+0000","last_peered":"2024-09-16T15:03:10.381301+0000","last_clean":"2024-09-16T15:03:10.381301+0000","last_became_active":"2024-09-16T14:55:58.160444+0000","last_became_peered":"2024-09-16T14:55:58.160444+0000","last_unstale":"2024-09-16T15:03:10.381301+0000","last_undegraded":"2024-09-16T15:03:10.381301+0000","last_fullsized":"2024-09-16T15:03:10.381301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4403","last_scrub_stamp":"2024-09-16T15:03:10.381261+0000","last_deep_scrub":"21'4403","last_deep_scrub_stamp":"2024-09-16T15:03:10.381261+0000","last_clean_scrub_stamp":"2024-09-16T15:03:10.381261+0000","objects_scrubbed":259,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:20:51.646361+0000","scrub_duration":1.0113366029999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":246548,"num_read_kb":15779072,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"21'2","reported_seq":36,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:19.379946+0000","last_change":"2024-09-16T15:03:19.380118+0000","last_active":"2024-09-16T15:03:19.379946+0000","last_peered":"2024-09-16T15:03:19.379946+0000","last_clean":"2024-09-16T15:03:19.379946+0000","last_became_active":"2024-09-16T14:55:47.589955+0000","last_became_peered":"2024-09-16T14:55:47.589955+0000","last_unstale":"2024-09-16T15:03:19.379946+0000","last_undegraded":"2024-09-16T15:03:19.379946+0000","last_fullsized":"2024-09-16T15:03:19.379946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'2","last_scrub_stamp":"2024-09-16T15:03:19.379893+0000","last_deep_scrub":"21'2","last_deep_scrub_stamp":"2024-09-16T15:03:19.379893+0000","last_clean_scrub_stamp":"2024-09-16T15:03:19.379893+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:21:53.617156+0000","scrub_duration":0.0061412530000000002,"objects_trimmed":0,"snaptrim_duration":0.00074397099999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"21'4420","reported_seq":252658,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:20.118703+0000","last_change":"2024-09-16T15:03:20.118943+0000","last_active":"2024-09-16T15:03:20.118703+0000","last_peered":"2024-09-16T15:03:20.118703+0000","last_clean":"2024-09-16T15:03:20.118703+0000","last_became_active":"2024-09-16T14:55:58.164104+0000","last_became_peered":"2024-09-16T14:55:58.164104+0000","last_unstale":"2024-09-16T15:03:20.118703+0000","last_undegraded":"2024-09-16T15:03:20.118703+0000","last_fullsized":"2024-09-16T15:03:20.118703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4420","last_scrub_stamp":"2024-09-16T15:03:20.118647+0000","last_deep_scrub":"21'4420","last_deep_scrub_stamp":"2024-09-16T15:03:20.118647+0000","last_clean_scrub_stamp":"2024-09-16T15:03:20.118647+0000","objects_scrubbed":260,"log_size":4420,"log_dups_size":0,"ondisk_log_size":4420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:38:16.434746+0000","scrub_duration":1.456719439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":260,"num_object_clones":0,"num_object_copies":780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":248189,"num_read_kb":15884096,"num_write":4160,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'4709","reported_seq":268440,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:26.141042+0000","last_change":"2024-09-16T15:03:26.141168+0000","last_active":"2024-09-16T15:03:26.141042+0000","last_peered":"2024-09-16T15:03:26.141042+0000","last_clean":"2024-09-16T15:03:26.141042+0000","last_became_active":"2024-09-16T14:55:57.740121+0000","last_became_peered":"2024-09-16T14:55:57.740121+0000","last_unstale":"2024-09-16T15:03:26.141042+0000","last_undegraded":"2024-09-16T15:03:26.141042+0000","last_fullsized":"2024-09-16T15:03:26.141042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4709","last_scrub_stamp":"2024-09-16T15:03:26.141012+0000","last_deep_scrub":"21'4709","last_deep_scrub_stamp":"2024-09-16T15:03:26.141012+0000","last_clean_scrub_stamp":"2024-09-16T15:03:26.141012+0000","objects_scrubbed":277,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:56.337510+0000","scrub_duration":1.5152880450000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":290455552,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":263679,"num_read_kb":16875456,"num_write":4432,"num_write_kb":283648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:21.436279+0000","last_change":"2024-09-16T15:03:21.436509+0000","last_active":"2024-09-16T15:03:21.436279+0000","last_peered":"2024-09-16T15:03:21.436279+0000","last_clean":"2024-09-16T15:03:21.436279+0000","last_became_active":"2024-09-16T14:55:47.589453+0000","last_became_peered":"2024-09-16T14:55:47.589453+0000","last_unstale":"2024-09-16T15:03:21.436279+0000","last_undegraded":"2024-09-16T15:03:21.436279+0000","last_fullsized":"2024-09-16T15:03:21.436279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:21.436231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:21.436231+0000","last_clean_scrub_stamp":"2024-09-16T15:03:21.436231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:10:37.109898+0000","scrub_duration":0.0032458650000000001,"objects_trimmed":0,"snaptrim_duration":0.000610518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'4505","reported_seq":291709,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:32.962453+0000","last_change":"2024-09-16T15:03:32.962711+0000","last_active":"2024-09-16T15:03:32.962453+0000","last_peered":"2024-09-16T15:03:32.962453+0000","last_clean":"2024-09-16T15:03:32.962453+0000","last_became_active":"2024-09-16T14:55:57.737731+0000","last_became_peered":"2024-09-16T14:55:57.737731+0000","last_unstale":"2024-09-16T15:03:32.962453+0000","last_undegraded":"2024-09-16T15:03:32.962453+0000","last_fullsized":"2024-09-16T15:03:32.962453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4505","last_scrub_stamp":"2024-09-16T15:03:32.962393+0000","last_deep_scrub":"21'4505","last_deep_scrub_stamp":"2024-09-16T15:03:32.962393+0000","last_clean_scrub_stamp":"2024-09-16T15:03:32.962393+0000","objects_scrubbed":265,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:05:02.363901+0000","scrub_duration":1.4491638849999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":277872640,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":265,"num_whiteouts":0,"num_read":252293,"num_read_kb":16146752,"num_write":4240,"num_write_kb":271360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5005,"num_bytes_recovered":5248122880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5005},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:11.058649+0000","last_change":"2024-09-16T15:03:11.058853+0000","last_active":"2024-09-16T15:03:11.058649+0000","last_peered":"2024-09-16T15:03:11.058649+0000","last_clean":"2024-09-16T15:03:11.058649+0000","last_became_active":"2024-09-16T14:55:47.788413+0000","last_became_peered":"2024-09-16T14:55:47.788413+0000","last_unstale":"2024-09-16T15:03:11.058649+0000","last_undegraded":"2024-09-16T15:03:11.058649+0000","last_fullsized":"2024-09-16T15:03:11.058649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:11.058600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:11.058600+0000","last_clean_scrub_stamp":"2024-09-16T15:03:11.058600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:50:48.961709+0000","scrub_duration":0.0031610509999999998,"objects_trimmed":0,"snaptrim_duration":0.00099114899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"21'4522","reported_seq":257831,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:24.107470+0000","last_change":"2024-09-16T15:03:24.107669+0000","last_active":"2024-09-16T15:03:24.107470+0000","last_peered":"2024-09-16T15:03:24.107470+0000","last_clean":"2024-09-16T15:03:24.107470+0000","last_became_active":"2024-09-16T14:55:58.160681+0000","last_became_peered":"2024-09-16T14:55:58.160681+0000","last_unstale":"2024-09-16T15:03:24.107470+0000","last_undegraded":"2024-09-16T15:03:24.107470+0000","last_fullsized":"2024-09-16T15:03:24.107470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4522","last_scrub_stamp":"2024-09-16T15:03:24.107431+0000","last_deep_scrub":"21'4522","last_deep_scrub_stamp":"2024-09-16T15:03:24.107431+0000","last_clean_scrub_stamp":"2024-09-16T15:03:24.107431+0000","objects_scrubbed":266,"log_size":4522,"log_dups_size":0,"ondisk_log_size":4522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:39:08.974970+0000","scrub_duration":1.451546985,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253260,"num_read_kb":16208640,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:16.726878+0000","last_change":"2024-09-16T15:03:16.727073+0000","last_active":"2024-09-16T15:03:16.726878+0000","last_peered":"2024-09-16T15:03:16.726878+0000","last_clean":"2024-09-16T15:03:16.726878+0000","last_became_active":"2024-09-16T14:55:48.061516+0000","last_became_peered":"2024-09-16T14:55:48.061516+0000","last_unstale":"2024-09-16T15:03:16.726878+0000","last_undegraded":"2024-09-16T15:03:16.726878+0000","last_fullsized":"2024-09-16T15:03:16.726878+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:16.726830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:16.726830+0000","last_clean_scrub_stamp":"2024-09-16T15:03:16.726830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:53:24.386278+0000","scrub_duration":0.039050964000000001,"objects_trimmed":0,"snaptrim_duration":0.00088323700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:21.161283+0000","last_change":"2024-09-16T15:03:21.161493+0000","last_active":"2024-09-16T15:03:21.161283+0000","last_peered":"2024-09-16T15:03:21.161283+0000","last_clean":"2024-09-16T15:03:21.161283+0000","last_became_active":"2024-09-16T14:55:47.787948+0000","last_became_peered":"2024-09-16T14:55:47.787948+0000","last_unstale":"2024-09-16T15:03:21.161283+0000","last_undegraded":"2024-09-16T15:03:21.161283+0000","last_fullsized":"2024-09-16T15:03:21.161283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T15:03:21.161225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T15:03:21.161225+0000","last_clean_scrub_stamp":"2024-09-16T15:03:21.161225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:25:15.717423+0000","scrub_duration":0.0030878289999999998,"objects_trimmed":0,"snaptrim_duration":0.00079356999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"21'4522","reported_seq":292088,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T15:03:23.962994+0000","last_change":"2024-09-16T15:03:23.963128+0000","last_active":"2024-09-16T15:03:23.962994+0000","last_peered":"2024-09-16T15:03:23.962994+0000","last_clean":"2024-09-16T15:03:23.962994+0000","last_became_active":"2024-09-16T14:55:58.164766+0000","last_became_peered":"2024-09-16T14:55:58.164766+0000","last_unstale":"2024-09-16T15:03:23.962994+0000","last_undegraded":"2024-09-16T15:03:23.962994+0000","last_fullsized":"2024-09-16T15:03:23.962994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'4522","last_scrub_stamp":"2024-09-16T15:03:23.962974+0000","last_deep_scrub":"21'4522","last_deep_scrub_stamp":"2024-09-16T15:03:23.962974+0000","last_clean_scrub_stamp":"2024-09-16T15:03:23.962974+0000","objects_scrubbed":266,"log_size":4522,"log_dups_size":0,"ondisk_log_size":4522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:06.956397+0000","scrub_duration":1.5390856610000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":278921216,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":266,"num_whiteouts":0,"num_read":253030,"num_read_kb":16193920,"num_write":4256,"num_write_kb":272384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4949,"num_bytes_recovered":5189402624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":4949},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4329504792,"num_objects":4130,"num_object_clones":0,"num_object_copies":12390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4130,"num_whiteouts":0,"num_read":3932939,"num_read_kb":251708033,"num_write":66064,"num_write_kb":4228033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24615,"num_bytes_recovered":25810698240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":24615},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12988526592,"data_stored":12988514376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70194,"ondisk_log_size":70194,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":4,"up_from":11,"seq":47244640354,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2202428,"kb_used_data":2131124,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":92169412,"statfs":{"total":96636764160,"available":94381477888,"internally_reserved":0,"allocated":2182270976,"data_stored":2182145596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73005510},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.44400000000000001},"min":{"1min":0.23000000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.498,"5min":0.70199999999999996,"15min":1.6399999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.38900000000000001,"15min":0.48999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.51100000000000001,"5min":0.75900000000000001,"15min":1.4039999999999999},"last":0.83099999999999996}]},{"osd":1,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.432},"min":{"1min":0.26500000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.73299999999999998,"5min":0.97599999999999998,"15min":1.079},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.44500000000000001},"min":{"1min":0.24099999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.45900000000000002,"5min":1.0529999999999999,"15min":1.1819999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.441,"15min":0.52700000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.248},"max":{"1min":0.58399999999999996,"5min":1.681,"15min":1.681},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.47699999999999998},"min":{"1min":0.29699999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.66200000000000003,"5min":0.94499999999999995,"15min":1.1020000000000001},"last":0.877}]},{"osd":3,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.36099999999999999,"15min":0.48799999999999999},"min":{"1min":0.26200000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.76200000000000001,"15min":1.274},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.378,"5min":0.375,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.56299999999999994,"5min":0.90000000000000002,"15min":1.5249999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Mon Sep 16 15:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.378,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":1.0109999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.504},"min":{"1min":0.27000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.55000000000000004,"5min":0.74199999999999999,"15min":1.347},"last":0.77500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640355,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2677500,"kb_used_data":2614388,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":91694340,"statfs":{"total":96636764160,"available":93895004160,"internally_reserved":0,"allocated":2677133312,"data_stored":2677007937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":64616904},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33000000000000002,"15min":0.45800000000000002},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":2.1309999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.43099999999999999,"15min":0.47999999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.23100000000000001},"max":{"1min":0.88100000000000001,"5min":1.377,"15min":1.377},"last":0.84599999999999997}]},{"osd":1,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.40699999999999997,"15min":0.53900000000000003},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.85099999999999998,"5min":1.587,"15min":1.8540000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.38800000000000001,"15min":0.52700000000000002},"min":{"1min":0.252,"5min":0.218,"15min":0.218},"max":{"1min":0.80200000000000005,"5min":1.1919999999999999,"15min":2.504},"last":0.877}]},{"osd":2,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.38900000000000001,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76900000000000002,"5min":0.93400000000000005,"15min":1.8080000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.56399999999999995},"min":{"1min":0.31,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":2.3679999999999999},"last":0.95699999999999996}]},{"osd":4,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.41299999999999998,"15min":0.46000000000000002},"min":{"1min":0.24099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.71899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.35499999999999998,"15min":0.51000000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":1.883},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Sep 16 15:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.60599999999999998},"min":{"1min":0.22600000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.68000000000000005,"5min":0.996,"15min":3.968},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.52900000000000003},"min":{"1min":0.29899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.82899999999999996,"5min":1.359,"15min":1.359},"last":0.91800000000000004}]}]},{"osd":2,"up_from":11,"seq":47244640354,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1649788,"kb_used_data":1604724,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92722052,"statfs":{"total":96636764160,"available":94947381248,"internally_reserved":0,"allocated":1643237376,"data_stored":1643112001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.26200000000000001,"15min":0.33500000000000002},"min":{"1min":0.17799999999999999,"5min":0.151,"15min":0.151},"max":{"1min":0.42299999999999999,"5min":0.79400000000000004,"15min":1.222},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36699999999999999,"15min":0.42799999999999999},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.64700000000000002,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.86799999999999999,"15min":0.57199999999999995},"min":{"1min":0.19500000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.71099999999999997,"5min":53.473999999999997,"15min":53.473999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.81100000000000005,"15min":0.58799999999999997},"min":{"1min":0.192,"5min":0.184,"15min":0.184},"max":{"1min":0.51800000000000002,"5min":53.326000000000001,"15min":53.326000000000001},"last":0.628}]},{"osd":3,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.47599999999999998},"min":{"1min":0.23799999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":1.1950000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.52600000000000002},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.26200000000000001},"max":{"1min":0.72999999999999998,"5min":1.839,"15min":1.839},"last":0.83699999999999997}]},{"osd":4,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.376,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":1.8380000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.47799999999999998},"min":{"1min":0.27200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.61899999999999999,"5min":0.65900000000000003,"15min":0.92900000000000005},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon Sep 16 15:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":1.016,"15min":0.70899999999999996},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":58.322000000000003,"15min":58.322000000000003},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.91900000000000004,"15min":0.70999999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72799999999999998,"5min":58.619,"15min":58.619},"last":0.74399999999999999}]}]},{"osd":1,"up_from":11,"seq":47244640354,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2604860,"kb_used_data":2393268,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":91766980,"statfs":{"total":96636764160,"available":93969387520,"internally_reserved":0,"allocated":2450706432,"data_stored":2450581057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216660422},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":24615,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.253,"15min":0.29599999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.41099999999999998,"5min":0.60199999999999998,"15min":0.72499999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.307,"15min":0.33500000000000002},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16400000000000001},"max":{"1min":0.54800000000000004,"5min":0.61099999999999999,"15min":0.77500000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.26200000000000001,"15min":0.34100000000000003},"min":{"1min":0.182,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.51900000000000002,"5min":0.64900000000000002,"15min":0.73299999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.33000000000000002,"15min":0.375},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.60299999999999998,"15min":0.88400000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.748,"15min":0.60899999999999999},"min":{"1min":0.29399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61299999999999999,"5min":30.193000000000001,"15min":30.193000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.69999999999999996,"15min":0.59199999999999997},"min":{"1min":0.27400000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.64900000000000002,"5min":30.173999999999999,"15min":30.173999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.38300000000000001,"15min":0.45600000000000002},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.68500000000000005,"15min":1.0860000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.45500000000000002,"15min":0.51700000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57199999999999995,"5min":0.89800000000000002,"15min":1.325},"last":0.84299999999999997}]},{"osd":5,"last update":"Mon Sep 16 15:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.40600000000000003,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.59199999999999997,"5min":0.98299999999999998,"15min":1.036},"last":0.878},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.438,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.48699999999999999,"5min":0.97199999999999998,"15min":1.2829999999999999},"last":0.82099999999999995}]}]},{"osd":5,"up_from":11,"seq":47244640355,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1338552,"kb_used_data":1285296,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":93033288,"statfs":{"total":96636764160,"available":95266086912,"internally_reserved":0,"allocated":1316143104,"data_stored":1316021801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54524359},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.377,"15min":0.45800000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.89000000000000001,"5min":2.286,"15min":2.286},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.51100000000000001},"min":{"1min":0.26100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.78800000000000003,"5min":1.103,"15min":1.536},"last":0.89700000000000002}]},{"osd":1,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":1.3500000000000001,"15min":0.79700000000000004},"min":{"1min":0.251,"5min":0.224,"15min":0.224},"max":{"1min":0.74299999999999999,"5min":79.933999999999997,"15min":79.933999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":1.327,"15min":0.77700000000000002},"min":{"1min":0.246,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.71099999999999997,"5min":79.793999999999997,"15min":79.793999999999997},"last":0.84799999999999998}]},{"osd":2,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41699999999999998,"15min":0.53300000000000003},"min":{"1min":0.28299999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.82699999999999996,"5min":0.85699999999999998,"15min":1.6180000000000001},"last":0.752},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.40999999999999998,"15min":0.48299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26700000000000002},"max":{"1min":0.68300000000000005,"5min":1.141,"15min":1.5940000000000001},"last":0.81399999999999995}]},{"osd":3,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39100000000000001,"15min":0.51900000000000002},"min":{"1min":0.23799999999999999,"5min":0.22500000000000001,"15min":0.20499999999999999},"max":{"1min":0.72199999999999998,"5min":2.2669999999999999,"15min":2.359},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45200000000000001,"15min":0.49399999999999999},"min":{"1min":0.28499999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.55200000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.93300000000000005}]},{"osd":4,"last update":"Mon Sep 16 15:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.379,"15min":0.48399999999999999},"min":{"1min":0.254,"5min":0.216,"15min":0.216},"max":{"1min":0.60499999999999998,"5min":1.1950000000000001,"15min":1.458},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44500000000000001,"15min":0.50600000000000001},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.23200000000000001},"max":{"1min":0.75800000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":0.78000000000000003}]}]},{"osd":0,"up_from":11,"seq":47244640355,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2741564,"kb_used_data":2656372,"kb_used_omap":1,"kb_used_meta":85182,"kb_avail":91630276,"statfs":{"total":96636764160,"available":93829402624,"internally_reserved":0,"allocated":2720124928,"data_stored":2719999548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87226822},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.26600000000000001,"15min":0.39500000000000002},"min":{"1min":0.17000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.45400000000000001,"5min":1.026,"15min":2.4620000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.30399999999999999,"15min":0.437},"min":{"1min":0.216,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":1.0369999999999999,"15min":2.5030000000000001},"last":0.83899999999999997}]},{"osd":2,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.27800000000000002,"15min":0.36699999999999999},"min":{"1min":0.20200000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.38800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.34799999999999998,"15min":0.38400000000000001},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.71399999999999997,"15min":0.60599999999999998},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":33.82,"15min":33.82},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.69599999999999995,"15min":0.58299999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.79100000000000004,"5min":32.356000000000002,"15min":32.356000000000002},"last":0.73699999999999999}]},{"osd":4,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41199999999999998,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57499999999999996,"5min":0.92500000000000004,"15min":2.8780000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.43099999999999999,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.67200000000000004,"5min":0.74399999999999999,"15min":0.86499999999999999},"last":0.874}]},{"osd":5,"last update":"Mon Sep 16 15:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39300000000000002,"15min":5.8540000000000001},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.47399999999999998,"5min":0.63,"15min":143.86699999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.442,"15min":0.56499999999999995},"min":{"1min":0.32200000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.56200000000000006,"5min":0.98299999999999998,"15min":2.9449999999999998},"last":0.68999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2719940608,"data_stored":2719940608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2450526208,"data_stored":2450522136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1643057152,"data_stored":1643053080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2676953088,"data_stored":2676949016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2182086656,"data_stored":2182086656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1315962880,"data_stored":1315962880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T15:03:52.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T15:03:52.414 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T15:03:52.414 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T15:03:52.415 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T15:03:52.415 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:03:52.495 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T15:03:52.495 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T15:03:52.495 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:03:58.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-16T15:03:58.597 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T15:03:58.597 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T15:03:58.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:03:58.670 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T15:03:58.670 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T15:03:58.670 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:03:58.739 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T15:03:58.739 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T15:03:58.739 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:04:03.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-16T15:04:03.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-16T15:04:04.841 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T15:04:04.841 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T15:04:04.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:04:04.906 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T15:04:04.907 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T15:04:04.907 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T15:04:04.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:04:04.936 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T15:04:04.936 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T15:04:04.936 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T15:04:04.937 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T15:04:04.999 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T15:04:04.999 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T15:04:04.999 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'missing primary copy of' | egrep -v 'objects unfound and apparently lost' | egrep -v 'had a read error' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(OSD_TOO_MANY_REPAIRS\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-16T15:04:05.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T15:04:05.209 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T15:04:05.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T15:04:05.427 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T15:04:05.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T15:04:05.678 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T15:04:05.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T15:04:05.836 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T15:04:05.965 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T15:04:05.966 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T15:04:06.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T15:04:06.172 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T15:04:06.345 INFO:tasks.ceph:Archiving mon data... 2024-09-16T15:04:06.347 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/data/mon.a.tgz 2024-09-16T15:04:06.347 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-16T15:04:06.358 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.rwGCVW9vZy 2024-09-16T15:04:06.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rwGCVW9vZy 2024-09-16T15:04:06.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.rwGCVW9vZy 2024-09-16T15:04:06.845 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.rwGCVW9vZy is 1MB 2024-09-16T15:04:06.919 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.rwGCVW9vZy 2024-09-16T15:04:06.926 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T15:04:06.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T15:04:06.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T15:04:07.008 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-16T15:04:07.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T15:04:07.053 DEBUG:teuthology.orchestra.run.smithi116:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T15:04:07.074 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T15:04:07.099 INFO:teuthology.orchestra.run.smithi116.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T15:04:07.103 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T15:04:07.104 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/remote/smithi079/crash 2024-09-16T15:04:07.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T15:04:07.131 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/remote/smithi116/crash 2024-09-16T15:04:07.132 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T15:04:07.177 INFO:tasks.ceph:Compressing logs... 2024-09-16T15:04:07.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T15:04:07.179 DEBUG:teuthology.orchestra.run.smithi116:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T15:04:08.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-16T15:09:47.360 INFO:tasks.ceph:Archiving logs... 2024-09-16T15:09:47.361 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/remote/smithi079/log 2024-09-16T15:09:47.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T15:10:20.578 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/remote/smithi116/log 2024-09-16T15:10:20.579 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T15:10:44.876 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T15:10:44.885 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T15:10:44.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T15:10:44.888 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T15:10:44.968 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T15:10:44.976 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T15:10:44.977 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T15:10:44.979 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T15:10:45.025 INFO:teuthology.orchestra.run.smithi116.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T15:10:45.025 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================== 2024-09-16T15:10:45.025 INFO:teuthology.orchestra.run.smithi116.stdout:*hv01.front.sepi 67.205.162.81 3 u 50 64 377 0.072 -2.124 0.982 2024-09-16T15:10:45.025 INFO:teuthology.orchestra.run.smithi116.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.065 -1.195 1.241 2024-09-16T15:10:45.025 INFO:teuthology.orchestra.run.smithi116.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 377 0.077 -2.177 0.984 2024-09-16T15:10:45.025 INFO:teuthology.orchestra.run.smithi116.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-16T15:10:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T15:10:45.051 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-16T15:10:45.051 INFO:teuthology.orchestra.run.smithi079.stdout:*hv01.front.sepi 67.205.162.81 3 u 58 64 377 0.096 -4.829 2.066 2024-09-16T15:10:45.051 INFO:teuthology.orchestra.run.smithi079.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 377 0.074 -1.771 2.924 2024-09-16T15:10:45.051 INFO:teuthology.orchestra.run.smithi079.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.084 -6.688 3.082 2024-09-16T15:10:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-16T15:10:45.052 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T15:10:45.060 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T15:10:45.061 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T15:10:45.069 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T15:10:45.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T15:10:45.086 INFO:teuthology.task.internal:Duration was 1491.883394 seconds 2024-09-16T15:10:45.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T15:10:45.101 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T15:10:45.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T15:10:45.104 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T15:10:45.288 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T15:10:45.288 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-16T15:10:45.288 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T15:10:45.299 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-16T15:10:45.299 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T15:10:45.310 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T15:10:45.310 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T15:10:45.341 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T15:10:45.385 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T15:10:45.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T15:10:45.421 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T15:10:45.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T15:10:45.611 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T15:10:45.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T15:10:45.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T15:10:45.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T15:10:45.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:10:45.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:10:45.704 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-16T15:10:45.726 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-16T15:10:45.752 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:10:45.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:10:45.784 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T15:10:45.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T15:10:45.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T15:10:45.808 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T15:10:45.809 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/remote/smithi079 2024-09-16T15:10:45.809 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T15:10:45.848 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906772/remote/smithi116 2024-09-16T15:10:45.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T15:10:45.868 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T15:10:45.868 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T15:10:45.893 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T15:10:45.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T15:10:45.921 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T15:10:45.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T15:10:45.929 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T15:10:45.929 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T15:10:45.946 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T15:10:45.949 INFO:teuthology.orchestra.run.smithi079.stdout: 658632 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 15:10 /home/ubuntu/cephtest 2024-09-16T15:10:45.959 INFO:teuthology.orchestra.run.smithi116.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 15:10 /home/ubuntu/cephtest 2024-09-16T15:10:45.960 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T15:10:45.969 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T15:10:45.991 INFO:teuthology.run:Summary data: description: rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} duration: 1491.8833937644958 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T15:10:45.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T15:10:46.098 INFO:teuthology.run:pass